Jul 31 07:16:19 devstack cinder-volume[77872]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 07:16:19 devstack cinder-volume[77872]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 07:16:19 devstack cinder-volume[77872]: we strongly recommend against using it for new projects. Jul 31 07:16:19 devstack cinder-volume[77872]: If you are already using Eventlet, we recommend migrating to a different Jul 31 07:16:19 devstack cinder-volume[77872]: framework. For more detail see Jul 31 07:16:19 devstack cinder-volume[77872]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 07:16:19 devstack cinder-volume[77872]: import eventlet # noqa Jul 31 07:16:21 devstack cinder-volume[77872]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 07:16:21 devstack cinder-volume[77872]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 07:16:21 devstack cinder-volume[77872]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 07:16:22 devstack cinder-volume[77872]: INFO dbcounter [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Registered counter for database cinder Jul 31 07:16:22 devstack cinder-volume[77872]: DEBUG oslo_db.sqlalchemy.engines [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG dbcounter [-] [77872] Writer thread running {{(pid=77872) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 07:16:23 devstack cinder-volume[77872]: INFO cinder.rpc [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 07:16:23 devstack cinder-volume[77872]: INFO cinder.rpc [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG oslo_db.sqlalchemy.engines [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:16:23 devstack cinder-volume[77872]: INFO cinder.volume.manager [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Determined volume DB was empty at startup. Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG cinder.volume.manager [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77872) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 07:16:23 devstack cinder-volume[77872]: INFO cinder.volume.manager [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 07:16:23 devstack cinder-volume[77872]: WARNING stevedore.named [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 07:16:23 devstack cinder-volume[77872]: WARNING castellan.key_manager [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 07:16:23 devstack cinder-volume[77872]: WARNING cinder.keymgr.conf_key_mgr [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG cinder.volume.drivers.lvm [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77872) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG oslo_concurrency.processutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG oslo_concurrency.processutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.382s {{(pid=77872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG oslo_db.sqlalchemy.engines [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:16:23 devstack cinder-volume[77872]: INFO cinder.rpc [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 31 07:16:23 devstack cinder-volume[77872]: INFO cinder.rpc [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 31 07:16:23 devstack cinder-volume[77872]: WARNING stevedore.named [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 07:16:23 devstack cinder-volume[77872]: WARNING castellan.key_manager [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 07:16:23 devstack cinder-volume[77872]: INFO cinder.volume.manager [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 31 07:16:23 devstack cinder-volume[77872]: DEBUG oslo_db.sqlalchemy.engines [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:16:24 devstack cinder-volume[77872]: INFO oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Starting 1 workers Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Started child 78015 {{(pid=77872) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 07:16:24 devstack cinder-volume[78015]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Full set of CONF: {{(pid=77872) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] ******************************************************************************** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Configuration options gathered from: {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] ================================================================================ {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] allow_availability_zone_fallback = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] allow_compression_on_image_upload = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] allowed_direct_url_schemes = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] api_rate_limit = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] auth_strategy = keystone {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] az_cache_duration = 3600 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_availability_zone = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_host = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_stats_polling_interval = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backup_api_class = cinder.backup.api.API {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backup_name_template = backup-%s {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backup_use_same_host = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backup_use_temp_snapshot = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] chap_password = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] chap_username = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_internal_tenant_project_id = 113c9d6903974dfa8bb7452443d647c2 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_internal_tenant_user_id = 6df7f0f3a0174ee7b25ea2f324ad4f3a {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cloned_volume_same_az = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cluster = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] compression_format = gzip {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] compute_api_class = cinder.compute.nova.API {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] config_dir = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] config_source = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] control_exchange = openstack {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] debug = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] default_availability_zone = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] default_group_type = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] default_volume_type = lvmdriver-1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] disk_geometry = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] driver_client_cert = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] driver_client_cert_key = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] driver_data_namespace = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] driver_ssl_cert_path = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] driver_ssl_cert_verify = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] driver_use_ssl = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] enable_force_upload = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] enable_new_services = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] enable_unsupported_driver = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] enforce_multipath_for_image_xfer = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] filter_function = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_api_insecure = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_api_ssl_compression = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_ca_certificates_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_catalog_info = image:glance:publicURL {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_num_retries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance_request_timeout = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] goodness_function = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] graceful_shutdown_timeout = 5 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] group_api_class = cinder.group.api.API {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] host = devstack {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_compress_on_upload = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_conversion_address_space_limit = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_conversion_cpu_limit = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_conversion_disable = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_upload_use_cinder_backend = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_upload_use_internal_tenant = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_volume_cache_enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_volume_cache_max_count = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] image_volume_cache_max_size_gb = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] init_host_max_objects_retrieval = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] instance_format = [instance: %(uuid)s] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] iscsi_target_flags = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] iscsi_write_cache = on {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] iser_helper = tgtadm {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] iser_ip_address = 192.168.122.134 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] iser_port = 3260 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_color = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_config_append = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_dir = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_options = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_rotate_interval = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_rotate_interval_type = days {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] log_rotation_type = none {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] max_age = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] max_logfile_count = 30 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] max_logfile_size_mb = 200 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] max_over_subscription_ratio = 20.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] message_reap_interval = 86400 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] message_ttl = 2592000 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] migration_create_volume_timeout_secs = 300 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] monkey_patch = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] monkey_patch_modules = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] my_ip = 192.168.122.134 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] no_snapshot_gb_quota = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] num_iser_scan_tries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] num_shell_tries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] num_volume_device_scan_tries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] nvmeof_conn_info_version = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] nvmet_ns_id = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] nvmet_port_id = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] osapi_max_limit = 1000 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] osapi_volume_ext_list = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] osapi_volume_listen_port = 8776 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] osapi_volume_use_ssl = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] osapi_volume_workers = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] per_volume_size_limit = -1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] periodic_fuzzy_delay = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] periodic_interval = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] public_endpoint = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] publish_errors = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] quota_backup_gigabytes = 1000 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] quota_backups = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] quota_gigabytes = 1000 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] quota_groups = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] quota_snapshots = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] quota_volumes = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] rate_limit_burst = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] rate_limit_except_level = CRITICAL {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] rate_limit_interval = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] reinit_driver_count = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] replication_device = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[78015]: INFO cinder.volume.manager [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] report_discard_supported = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] report_interval = 120 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] reservation_clean_interval = 86400 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] reservation_expire = 86400 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] reserved_image_namespaces = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] reserved_percentage = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] rpc_response_timeout = 120 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] run_external_periodic_tasks = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] scst_target_driver = iscsi {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] scst_target_iqn_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_down_time = 720 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] shell_completion = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] snapshot_name_template = snapshot-%s {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] snapshot_same_host = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] split_loggers = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] state_path = /opt/stack/data/cinder {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] storage_availability_zone = nova {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] storage_protocol = iSCSI {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] syslog_log_facility = LOG_USER {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] target_helper = lioadm {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] target_ip_address = 192.168.122.134 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] target_port = 3260 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] target_protocol = iscsi {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] target_secondary_ip_addresses = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] trace_flags = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] transport_url = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] until_refresh = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] use_chap_auth = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] use_default_quota_class = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] use_journal = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] use_json = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] use_multipath_for_image_xfer = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] use_stderr = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] use_syslog = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] verify_glance_signatures = enabled {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_api_class = cinder.volume.api.API {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_backend_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_clear = zero {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_clear_ionice = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_clear_size = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_copy_bps_limit = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_dd_blocksize = 1M {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_name_template = volume-%s {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_service_inithost_offload = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volume_usage_audit_period = month {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] zoning_mode = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_concurrency.disable_process_locking = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.auth_section = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.auth_type = password {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.auth_version = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.cache = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.include_service_catalog = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.insecure = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.interface = public {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_password = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcache_username = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.region_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.service_type = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.backend = dogpile.cache.null {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.backend_argument = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.backend_expiration_time = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.config_prefix = cache.oslo {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.debug_cache_backend = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.enable_retry_client = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.enable_socket_keepalive = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.expiration_time = 600 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.hashclient_retry_attempts = 2 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.memcache_dead_retry = 300 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.memcache_pool_maxsize = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.memcache_sasl_enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.password = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.proxies = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.redis_db = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.redis_server = localhost:6379 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.retry_attempts = 2 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.retry_delay = 0.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.socket_keepalive_count = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.socket_keepalive_idle = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.socket_keepalive_interval = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.socket_timeout = 1.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.tls_allowed_ciphers = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.tls_cafile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.tls_certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.tls_enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.tls_keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cache.username = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] coordination.backend_url = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.asyncio_connection = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.asyncio_slave_connection = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.backend = sqlalchemy {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.connection = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.connection_debug = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.connection_parameters = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.connection_recycle_time = 3600 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.connection_trace = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.db_inc_retry_interval = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.db_max_retries = 20 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.db_max_retry_interval = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.db_retry_interval = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.max_overflow = 50 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.max_pool_size = 5 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.max_retries = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.mysql_wsrep_sync_wait = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.pool_timeout = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.retry_interval = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.slave_connection = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.sqlite_synchronous = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.synchronous_reader = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] database.use_db_reconnect = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.connection_string = messaging:// {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.es_doc_type = notification {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.es_scroll_size = 10000 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.es_scroll_time = 2m {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.filter_error_trace = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.hmac_keys = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.sentinel_service_name = mymaster {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.socket_timeout = 0.1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.trace_requests = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler.trace_sqlalchemy = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler_jaeger.process_tags = {} {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler_jaeger.service_name_prefix = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] profiler_otlp.service_name_prefix = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.enforce_new_defaults = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.policy_default_rule = default {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.policy_file = policy.yaml {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] privsep_osbrick.group = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] privsep_osbrick.helper_command = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] privsep_osbrick.user = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_sys_admin.group = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_sys_admin.helper_command = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] cinder_sys_admin.user = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.auth_section = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.auth_type = password {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.cafile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.collect_timing = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.insecure = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.send_service_user_token = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.split_loggers = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] service_user.timeout = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.auth_section = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.auth_type = password {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.collect_timing = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.insecure = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.region_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.split_loggers = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] glance.timeout = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.backend_availability_zone = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.chap_password = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.chap_username = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.disk_geometry = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.driver_client_cert = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.driver_client_cert_key = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.driver_data_namespace = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.driver_use_ssl = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.extra_capabilities = {} {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack sudo[78020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.filter_function = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.goodness_function = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.iscsi_target_flags = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.iscsi_write_cache = on {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.iser_helper = tgtadm {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.iser_port = 3260 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack sudo[78020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.lvm_share_target = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.lvm_type = auto {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.num_shell_tries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.replication_device = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.report_discard_supported = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.reserved_percentage = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.target_helper = tgtadm {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.target_port = 3260 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.target_protocol = iscsi {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.trace_flags = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.unique_fqdn_network = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.use_chap_auth = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_backend_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_clear = zero {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_clear_ionice = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_clear_size = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_reports.file_event_handler = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_reports.log_dir = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.backend_host = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.chap_password = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.chap_username = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.disk_geometry = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.driver_client_cert = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.extra_capabilities = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.filter_function = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.goodness_function = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.iser_helper = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.iser_ip_address = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.iser_port = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.lvm_share_target = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.lvm_type = auto {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.num_shell_tries = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.replication_device = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.report_discard_supported = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.reserved_percentage = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.scst_target_driver = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.storage_protocol = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.target_helper = lioadm {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.target_ip_address = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.target_port = 3260 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.trace_flags = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.use_chap_auth = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_clear = zero {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_clear_size = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] lvmdriver-1.volumes_dir = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.ssl = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_notifications.driver = [] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_notifications.retry = -1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] key_manager.fixed_key = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.barbican_api_version = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.barbican_endpoint = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.barbican_endpoint_type = public {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.barbican_region_name = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.cafile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.collect_timing = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.insecure = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.number_of_retries = 60 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.retry_delay = 1 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.send_service_user_token = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.split_loggers = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.timeout = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.verify_ssl = True {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican.verify_ssl_path = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.auth_section = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.auth_type = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.cafile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.certfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.collect_timing = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.insecure = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.keyfile = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.split_loggers = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] barbican_service_user.timeout = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.approle_role_id = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.approle_secret_id = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.auth_method = approle {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.auth_path = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.kv_mountpoint = secret {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.kv_path = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.kv_version = 2 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.namespace = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.root_token_id = **** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.ssl_ca_crt_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.timeout = 60.0 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.token_file = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.token_role = None {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.use_ssl = False {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:16:24 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] ******************************************************************************** {{(pid=77872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 07:16:24 devstack sudo[78020]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:24 devstack sudo[78031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:24 devstack sudo[78031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:24 devstack sudo[78031]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:16:24 devstack cinder-volume[78015]: INFO cinder.brick.local_dev.lvm [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:24 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:24 devstack sudo[78116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:16:24 devstack sudo[78116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:25 devstack sudo[78116]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:25 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:25 devstack cinder-volume[78015]: DEBUG cinder.brick.local_dev.lvm [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78015) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 31 07:16:25 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:25 devstack sudo[78231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:25 devstack sudo[78231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:25 devstack sudo[78231]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:25 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:25 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:25 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:25 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:25 devstack sudo[78424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:25 devstack sudo[78424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:26 devstack sudo[78424]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:26 devstack sudo[78514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 31 07:16:26 devstack sudo[78514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:26 devstack sudo[78514]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.314s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:26 devstack sudo[78634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:16:26 devstack sudo[78634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:26 devstack sudo[78634]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:26 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:26 devstack sudo[78637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:16:26 devstack sudo[78637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:27 devstack sudo[78637]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.376s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:27 devstack sudo[78721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:16:27 devstack sudo[78721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:27 devstack sudo[78721]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:27 devstack sudo[78724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:27 devstack sudo[78724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:27 devstack sudo[78724]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:27 devstack sudo[78790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:27 devstack sudo[78790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:27 devstack sudo[78790]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:27 devstack cinder-volume[78015]: INFO cinder.volume.drivers.lvm [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:27 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:27 devstack sudo[78818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:27 devstack sudo[78818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:28 devstack sudo[78818]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:28 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:28 devstack cinder-volume[78015]: DEBUG cinder.volume.drivers.lvm [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Updating volume stats {{(pid=78015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 07:16:28 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:28 devstack sudo[78827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:16:28 devstack sudo[78827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:28 devstack sudo[78827]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:28 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:28 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:28 devstack sudo[78830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:16:28 devstack sudo[78830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:28 devstack sudo[78830]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:28 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:28 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:28 devstack sudo[78833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:28 devstack sudo[78833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:28 devstack sudo[78833]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:29 devstack sudo[78836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:16:29 devstack sudo[78836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:29 devstack sudo[78836]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:29 devstack cinder-volume[78015]: INFO cinder.volume.driver [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG cinder.volume.driver [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78015) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG dbcounter [-] [78015] Writer thread running {{(pid=78015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG cinder.db.api [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Building query based on filter {{(pid=78015) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG cinder.image.image_utils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78015) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 07:16:29 devstack cinder-volume[78015]: INFO cinder.keymgr.migration [None req-e350acff-98e4-4024-83b5-2366f9afa90b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG cinder.volume.drivers.lvm [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Updating volume stats {{(pid=78015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:29 devstack sudo[78840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:16:29 devstack sudo[78840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:29 devstack sudo[78840]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:29 devstack sudo[78844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:16:29 devstack sudo[78844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:29 devstack sudo[78844]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:29 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:29 devstack sudo[78849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:29 devstack sudo[78849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:30 devstack sudo[78849]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:30 devstack sudo[78852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:16:30 devstack sudo[78852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:30 devstack sudo[78852]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG cinder.manager [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Notifying Schedulers of capabilities ... {{(pid=78015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:16:30 devstack cinder-volume[78015]: INFO cinder.volume.manager [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Driver initialization completed successfully. Jul 31 07:16:30 devstack cinder-volume[78015]: INFO cinder.manager [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Initiating service 2 cleanup Jul 31 07:16:30 devstack cinder-volume[78015]: INFO cinder.manager [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Service 2 cleanup completed. Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG cinder.service [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Creating RPC server for service cinder-volume {{(pid=78015) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG cinder.service [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78015) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 07:16:30 devstack cinder-volume[78015]: INFO cinder.volume.manager [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG cinder.volume.drivers.lvm [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Updating volume stats {{(pid=78015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:30 devstack sudo[78855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:16:30 devstack sudo[78855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:30 devstack sudo[78855]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:30 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:30 devstack sudo[78860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:16:30 devstack sudo[78860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:31 devstack sudo[78860]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:31 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:31 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:31 devstack sudo[78863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:16:31 devstack sudo[78863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:31 devstack sudo[78863]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:31 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:31 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:16:31 devstack sudo[78869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:16:31 devstack sudo[78869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:16:31 devstack sudo[78869]: pam_unix(sudo:session): session closed for user root Jul 31 07:16:31 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:16:31 devstack cinder-volume[78015]: INFO cinder.volume.manager [None req-4fa13303-e88a-48fd-b834-19461157d640 None None] Driver post RPC initialization completed successfully. Jul 31 07:16:34 devstack cinder-volume[77872]: DEBUG dbcounter [-] [77872] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77872) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:16:40 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager._thread_info {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:16:40 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread count: 6 {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:16:40 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread info: [<_MainThread(MainThread, started 138535919267968)>, , , , , ] {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:16:41 devstack cinder-volume[78015]: DEBUG dbcounter [-] [78015] Writing DB stats cinder:SELECT=3 {{(pid=78015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:16:41 devstack cinder-volume[78015]: DEBUG dbcounter [-] [78015] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=78015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:17:40 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:17:40 devstack cinder-volume[78015]: DEBUG cinder.volume.drivers.lvm [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Updating volume stats {{(pid=78015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 07:17:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:17:40 devstack sudo[80946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:17:40 devstack sudo[80946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:17:40 devstack sudo[80946]: pam_unix(sudo:session): session closed for user root Jul 31 07:17:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:17:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:17:40 devstack sudo[80949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:17:40 devstack sudo[80949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:17:41 devstack sudo[80949]: pam_unix(sudo:session): session closed for user root Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:17:41 devstack sudo[80952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:17:41 devstack sudo[80952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:17:41 devstack sudo[80952]: pam_unix(sudo:session): session closed for user root Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:17:41 devstack sudo[81053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:17:41 devstack sudo[81053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:17:41 devstack sudo[81053]: pam_unix(sudo:session): session closed for user root Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG cinder.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Notifying Schedulers of capabilities ... {{(pid=78015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager._thread_info {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread count: 6 {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:17:41 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread info: [<_MainThread(MainThread, started 138535919267968)>, , , , , ] {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:18:40 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:18:40 devstack cinder-volume[78015]: DEBUG cinder.volume.drivers.lvm [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Updating volume stats {{(pid=78015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 07:18:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:18:40 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:18:40 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:18:40 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Jul 31 07:18:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:18:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:18:40 devstack sudo[84412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:18:40 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:18:41 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:18:41 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:18:41 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:18:41 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:18:41 devstack sudo[84423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:18:41 devstack sudo[84423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG dbcounter [-] [78015] Writing DB stats cinder:SELECT=1 {{(pid=78015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG dbcounter [-] [78015] Writing DB stats cinder:UPDATE=1 {{(pid=78015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:18:41 devstack sudo[84423]: pam_unix(sudo:session): session closed for user root Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:18:41 devstack cinder-volume[78015]: DEBUG cinder.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Notifying Schedulers of capabilities ... {{(pid=78015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:19:40 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:19:40 devstack cinder-volume[78015]: DEBUG cinder.volume.drivers.lvm [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Updating volume stats {{(pid=78015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 07:19:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:19:40 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:19:40 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:19:40 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Jul 31 07:19:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:19:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:19:40 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:19:40 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:19:41 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:19:41 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:19:41 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:19:41 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:19:41 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:19:41 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:19:41 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG cinder.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Notifying Schedulers of capabilities ... {{(pid=78015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager._thread_info {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread count: 6 {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:19:41 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread info: [<_MainThread(MainThread, started 138535919267968)>, , , , , ] {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:20:40 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:20:40 devstack cinder-volume[78015]: DEBUG cinder.volume.drivers.lvm [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Updating volume stats {{(pid=78015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 07:20:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:20:40 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 07:20:40 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:20:40 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Jul 31 07:20:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:20:40 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:20:40 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:20:40 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:20:41 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:20:41 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 07:20:41 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:20:41 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:20:41 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 07:20:41 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:20:41 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG dbcounter [-] [78015] Writing DB stats cinder:SELECT=1 {{(pid=78015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG oslo_concurrency.processutils [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=78015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG cinder.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Notifying Schedulers of capabilities ... {{(pid=78015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG dbcounter [-] [78015] Writing DB stats cinder:UPDATE=1 {{(pid=78015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG oslo_service.periodic_task [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] Running periodic task VolumeManager._thread_info {{(pid=78015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread count: 6 {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:20:41 devstack cinder-volume[78015]: DEBUG cinder.volume.manager [None req-3a12464a-9494-42c0-99d8-1439525edf92 None None] thread info: [<_MainThread(MainThread, started 138535919267968)>, , , , , ] {{(pid=78015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:20:56 devstack cinder-volume[77872]: INFO oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Caught SIGTERM, stopping children Jul 31 07:20:56 devstack cinder-volume[77872]: DEBUG oslo_concurrency.lockutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Acquiring lock "singleton_lock" {{(pid=77872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 07:20:56 devstack cinder-volume[77872]: DEBUG oslo_concurrency.lockutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Acquired lock "singleton_lock" {{(pid=77872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 07:20:56 devstack cinder-volume[77872]: DEBUG oslo_concurrency.lockutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Releasing lock "singleton_lock" {{(pid=77872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 07:20:56 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Stop services. {{(pid=77872) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 07:20:56 devstack cinder-volume[77872]: DEBUG oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Killing children. {{(pid=77872) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 07:20:56 devstack cinder-volume[77872]: INFO oslo_service.backend._eventlet.service [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Waiting on 1 children to exit Jul 31 07:21:01 devstack cinder-volume[78015]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 31 07:21:02 devstack cinder-volume[88123]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 07:21:02 devstack cinder-volume[88123]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 07:21:02 devstack cinder-volume[88123]: we strongly recommend against using it for new projects. Jul 31 07:21:02 devstack cinder-volume[88123]: If you are already using Eventlet, we recommend migrating to a different Jul 31 07:21:02 devstack cinder-volume[88123]: framework. For more detail see Jul 31 07:21:02 devstack cinder-volume[88123]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 07:21:02 devstack cinder-volume[88123]: import eventlet # noqa Jul 31 07:21:04 devstack cinder-volume[88123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88123) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 07:21:04 devstack cinder-volume[88123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88123) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 07:21:04 devstack cinder-volume[88123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88123) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 07:21:04 devstack cinder-volume[88123]: INFO dbcounter [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Registered counter for database cinder Jul 31 07:21:04 devstack cinder-volume[88123]: DEBUG oslo_db.sqlalchemy.engines [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88123) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG dbcounter [-] [88123] Writer thread running {{(pid=88123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 07:21:05 devstack cinder-volume[88123]: INFO cinder.rpc [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 07:21:05 devstack cinder-volume[88123]: INFO cinder.rpc [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_db.sqlalchemy.engines [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88123) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:05 devstack cinder-volume[88123]: INFO cinder.volume.manager [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Determined volume DB was empty at startup. Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG cinder.volume.manager [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88123) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 07:21:05 devstack cinder-volume[88123]: INFO cinder.volume.manager [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 07:21:05 devstack cinder-volume[88123]: WARNING stevedore.named [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 07:21:05 devstack cinder-volume[88123]: WARNING castellan.key_manager [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 07:21:05 devstack cinder-volume[88123]: WARNING cinder.keymgr.conf_key_mgr [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 07:21:05 devstack cinder-volume[88123]: INFO cinder.volume.manager [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_db.sqlalchemy.engines [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88123) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:05 devstack cinder-volume[88123]: INFO oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Starting 1 workers Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Started child 88343 {{(pid=88123) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Full set of CONF: {{(pid=88123) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] ******************************************************************************** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Configuration options gathered from: {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] ================================================================================ {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] allow_availability_zone_fallback = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] allow_compression_on_image_upload = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] allowed_direct_url_schemes = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] api_rate_limit = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] auth_strategy = keystone {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_availability_zone = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_host = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_stats_polling_interval = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backup_api_class = cinder.backup.api.API {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backup_name_template = backup-%s {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backup_use_same_host = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backup_use_temp_snapshot = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] chap_password = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88343]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] chap_username = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_internal_tenant_project_id = 113c9d6903974dfa8bb7452443d647c2 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_internal_tenant_user_id = 6df7f0f3a0174ee7b25ea2f324ad4f3a {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cluster = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] compression_format = gzip {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] compute_api_class = cinder.compute.nova.API {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] config_dir = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] config_source = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] control_exchange = openstack {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] debug = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] default_availability_zone = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] default_group_type = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] default_volume_type = QuobyteHD {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] disk_geometry = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] driver_client_cert = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] driver_client_cert_key = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] driver_data_namespace = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] driver_ssl_cert_path = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] driver_ssl_cert_verify = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] driver_use_ssl = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] enable_new_services = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] enable_unsupported_driver = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] enabled_backends = ['QuobyteHD'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] enforce_multipath_for_image_xfer = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] filter_function = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_api_insecure = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_api_ssl_compression = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_ca_certificates_file = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_catalog_info = image:glance:publicURL {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_num_retries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance_request_timeout = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] goodness_function = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] graceful_shutdown_timeout = 5 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] group_api_class = cinder.group.api.API {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] host = devstack {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_compress_on_upload = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_conversion_address_space_limit = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_conversion_cpu_limit = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_conversion_disable = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_upload_use_cinder_backend = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_upload_use_internal_tenant = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_volume_cache_enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_volume_cache_max_count = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] image_volume_cache_max_size_gb = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] init_host_max_objects_retrieval = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] instance_format = [instance: %(uuid)s] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] iscsi_target_flags = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] iscsi_write_cache = on {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] iser_helper = tgtadm {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] iser_ip_address = 192.168.122.134 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] iser_port = 3260 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_color = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_config_append = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_dir = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_file = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_options = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_rotate_interval = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_rotate_interval_type = days {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] log_rotation_type = none {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] max_age = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] max_logfile_count = 30 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] max_logfile_size_mb = 200 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[78015]: DEBUG oslo_concurrency.lockutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Acquiring lock "singleton_lock" {{(pid=78015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 07:21:05 devstack cinder-volume[78015]: DEBUG oslo_concurrency.lockutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Acquired lock "singleton_lock" {{(pid=78015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] max_over_subscription_ratio = 20.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] message_reap_interval = 86400 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] message_ttl = 2592000 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] migration_create_volume_timeout_secs = 300 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] monkey_patch = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] monkey_patch_modules = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] my_ip = 192.168.122.134 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] no_snapshot_gb_quota = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] num_iser_scan_tries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] num_shell_tries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] num_volume_device_scan_tries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] nvmeof_conn_info_version = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] nvmet_ns_id = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] nvmet_port_id = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] osapi_max_limit = 1000 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] osapi_volume_ext_list = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[78015]: DEBUG oslo_concurrency.lockutils [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Releasing lock "singleton_lock" {{(pid=78015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] osapi_volume_listen_port = 8776 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] osapi_volume_use_ssl = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] osapi_volume_workers = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] per_volume_size_limit = -1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] periodic_fuzzy_delay = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] periodic_interval = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] public_endpoint = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] publish_errors = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] quota_backup_gigabytes = 1000 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] quota_backups = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] quota_gigabytes = 1000 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] quota_groups = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] quota_snapshots = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] quota_volumes = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] rate_limit_burst = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] rate_limit_except_level = CRITICAL {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] rate_limit_interval = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] reinit_driver_count = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] replication_device = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] report_discard_supported = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] report_interval = 120 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] reservation_clean_interval = 86400 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] reservation_expire = 86400 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] reserved_image_namespaces = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] reserved_percentage = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] rpc_response_timeout = 120 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] run_external_periodic_tasks = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] scst_target_driver = iscsi {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] scst_target_iqn_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[78015]: WARNING amqp [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_down_time = 720 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] shell_completion = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] snapshot_name_template = snapshot-%s {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] split_loggers = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] state_path = /opt/stack/data/cinder {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] storage_availability_zone = nova {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] storage_protocol = iSCSI {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] syslog_log_facility = LOG_USER {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] target_helper = lioadm {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] target_ip_address = 192.168.122.134 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] target_port = 3260 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] target_protocol = iscsi {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] target_secondary_ip_addresses = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] trace_flags = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] transport_url = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] until_refresh = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] use_chap_auth = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] use_default_quota_class = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] use_journal = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] use_json = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] use_multipath_for_image_xfer = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] use_stderr = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] use_syslog = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] verify_glance_signatures = enabled {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_api_class = cinder.volume.api.API {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_backend_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_clear = zero {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_clear_ionice = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_clear_size = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_copy_bps_limit = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_dd_blocksize = 1M {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_name_template = volume-%s {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_service_inithost_offload = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volume_usage_audit_period = month {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] zoning_mode = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_concurrency.disable_process_locking = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88343]: INFO cinder.volume.manager [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Starting volume driver QuobyteDriver (1.2) Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.auth_section = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.auth_type = password {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.auth_version = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.cache = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.include_service_catalog = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.insecure = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.interface = public {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[78015]: WARNING amqp [None req-12a7d81a-d18c-4979-87eb-6578fb6e7cd6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.remotefs [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88343) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_password = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcache_username = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.region_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.service_type = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.backend = dogpile.cache.null {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.backend_argument = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.backend_expiration_time = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.config_prefix = cache.oslo {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.debug_cache_backend = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.enable_retry_client = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.enable_socket_keepalive = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.expiration_time = 600 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.hashclient_retry_attempts = 2 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.memcache_dead_retry = 300 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.memcache_pool_maxsize = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.memcache_sasl_enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.password = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.proxies = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.redis_db = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.redis_server = localhost:6379 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.retry_attempts = 2 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.retry_delay = 0.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.socket_keepalive_count = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.socket_keepalive_idle = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.socket_keepalive_interval = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.socket_timeout = 1.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.tls_allowed_ciphers = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.tls_cafile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.tls_certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.tls_enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.tls_keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cache.username = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] coordination.backend_url = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.asyncio_connection = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.asyncio_slave_connection = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.backend = sqlalchemy {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.connection = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.connection_debug = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.connection_parameters = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.connection_recycle_time = 3600 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.connection_trace = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.db_inc_retry_interval = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.db_max_retries = 20 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.db_max_retry_interval = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.db_retry_interval = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.max_overflow = 50 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.max_pool_size = 5 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.max_retries = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.mysql_wsrep_sync_wait = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.pool_timeout = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.retry_interval = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.slave_connection = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.sqlite_synchronous = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.synchronous_reader = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] database.use_db_reconnect = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.connection_string = messaging:// {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.es_doc_type = notification {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.es_scroll_size = 10000 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.es_scroll_time = 2m {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.filter_error_trace = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.hmac_keys = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.sentinel_service_name = mymaster {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.socket_timeout = 0.1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.trace_requests = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler.trace_sqlalchemy = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler_jaeger.process_tags = {} {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler_jaeger.service_name_prefix = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] profiler_otlp.service_name_prefix = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.enforce_new_defaults = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.policy_default_rule = default {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.policy_file = policy.yaml {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] privsep_osbrick.group = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] privsep_osbrick.helper_command = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] privsep_osbrick.user = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_sys_admin.group = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_sys_admin.helper_command = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] cinder_sys_admin.user = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.auth_section = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.auth_type = password {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.cafile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.collect_timing = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.insecure = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.send_service_user_token = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.split_loggers = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] service_user.timeout = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.auth_section = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.auth_type = password {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.collect_timing = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.insecure = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.region_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.split_loggers = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] glance.timeout = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.backend_availability_zone = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.chap_password = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.chap_username = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.disk_geometry = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.driver_client_cert = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.driver_client_cert_key = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.driver_data_namespace = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.driver_use_ssl = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.extra_capabilities = {} {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.filter_function = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.goodness_function = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.iscsi_target_flags = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.iscsi_write_cache = on {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.iser_helper = tgtadm {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.iser_port = 3260 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_host = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_login = admin {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_mount_options = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_password = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_private_key = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_share_path = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.num_shell_tries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.quobyte_volume_url = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.replication_device = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.report_discard_supported = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.reserved_percentage = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.target_helper = tgtadm {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.target_port = 3260 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.target_protocol = iscsi {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.trace_flags = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.unique_fqdn_network = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.use_chap_auth = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_backend_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_clear = zero {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_clear_ionice = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_clear_size = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_reports.file_event_handler = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_reports.log_dir = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.backend_availability_zone = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.backend_host = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.chap_password = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.chap_username = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.chiscsi_conf = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.disk_geometry = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.driver_client_cert = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.driver_data_namespace = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.driver_use_ssl = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.extra_capabilities = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.filter_function = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.goodness_function = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.iser_helper = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.iser_ip_address = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.iser_port = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.iser_target_prefix = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88343) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_host = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_login = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_mount_options = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88343]: WARNING cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_password = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88343]: WARNING cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_private_key = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_share_path = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_ssh_port = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Running cmd (subprocess): mount.quobyte {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.num_shell_tries = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.nvmet_port_id = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.replication_device = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.report_discard_supported = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.reserved_percentage = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.scst_target_driver = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.storage_protocol = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.target_helper = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.target_ip_address = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.target_port = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.target_prefix = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.target_protocol = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.trace_flags = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.use_chap_auth = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_clear = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_clear_size = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] QuobyteHD.volumes_dir = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.ssl = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_notifications.driver = [] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_notifications.retry = -1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] key_manager.fixed_key = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.barbican_api_version = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.barbican_endpoint = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.barbican_endpoint_type = public {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.barbican_region_name = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.cafile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.collect_timing = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.insecure = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.number_of_retries = 60 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.retry_delay = 1 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.send_service_user_token = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.split_loggers = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.timeout = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.verify_ssl = True {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican.verify_ssl_path = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.auth_section = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.auth_type = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.cafile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.certfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.collect_timing = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.insecure = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.keyfile = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.split_loggers = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] barbican_service_user.timeout = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.approle_role_id = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.approle_secret_id = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.auth_method = approle {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.auth_path = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.kv_mountpoint = secret {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.kv_path = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.kv_version = 2 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.namespace = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.root_token_id = **** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.ssl_ca_crt_file = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.timeout = 60.0 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.token_file = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.token_role = None {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.use_ssl = False {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:05 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] ******************************************************************************** {{(pid=88123) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 07:21:05 devstack quobyte-client[88352]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 07:21:05 devstack quobyte-client[88352]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88343) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:21:05 devstack cinder-volume[88343]: INFO cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 ... Jul 31 07:21:05 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 -c /etc/quobyte/client-cinder.cfg {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:05 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 -c /etc/quobyte/client-cinder.cfg Jul 31 07:21:05 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:21:06 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.382s {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:06 devstack cinder-volume[88343]: INFO cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 succeeded Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88343) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.393s {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:06 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:21:06 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:21:06 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.225s {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:06 devstack cinder-volume[88343]: INFO cinder.volume.driver [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Driver hasn't implemented _init_vendor_properties() Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.volume.driver [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540397644043, 'free_capacity_gb': 1775.7540397644043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88343) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_db.sqlalchemy.engines [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88343) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG dbcounter [-] [88343] Writer thread running {{(pid=88343) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.db.api [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Building query based on filter {{(pid=88343) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.image.image_utils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88343) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 07:21:06 devstack cinder-volume[88343]: INFO cinder.keymgr.migration [None req-cc9ad54f-c601-42ae-9489-233517fdeda7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88343) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88343) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:06 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:21:06 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:21:06 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.243s {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.manager [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Notifying Schedulers of capabilities ... {{(pid=88343) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:21:06 devstack cinder-volume[88343]: INFO cinder.volume.manager [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Driver initialization completed successfully. Jul 31 07:21:06 devstack cinder-volume[88343]: INFO cinder.manager [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Initiating service 3 cleanup Jul 31 07:21:06 devstack cinder-volume[88343]: INFO cinder.manager [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Service 3 cleanup completed. Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.service [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Creating RPC server for service cinder-volume {{(pid=88343) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 07:21:06 devstack cinder-volume[88343]: DEBUG cinder.service [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88343) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 07:21:07 devstack cinder-volume[88343]: INFO cinder.volume.manager [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 31 07:21:07 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:21:07 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:21:07 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88343) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:21:07 devstack cinder-volume[88343]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88343) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:21:07 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:21:07 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:07 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:21:07 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:21:07 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Jul 31 07:21:07 devstack cinder-volume[88343]: DEBUG oslo_concurrency.processutils [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.256s {{(pid=88343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:07 devstack cinder-volume[88343]: INFO cinder.volume.manager [None req-6d9ebd88-6a65-4bbb-90c9-9bf7dd20be2f None None] Driver post RPC initialization completed successfully. Jul 31 07:21:10 devstack cinder-volume[88123]: INFO oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Caught SIGTERM, stopping children Jul 31 07:21:10 devstack cinder-volume[88123]: DEBUG oslo_concurrency.lockutils [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Acquiring lock "singleton_lock" {{(pid=88123) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 07:21:10 devstack cinder-volume[88123]: DEBUG oslo_concurrency.lockutils [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Acquired lock "singleton_lock" {{(pid=88123) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 07:21:10 devstack cinder-volume[88123]: DEBUG oslo_concurrency.lockutils [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Releasing lock "singleton_lock" {{(pid=88123) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 07:21:10 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Stop services. {{(pid=88123) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 07:21:10 devstack cinder-volume[88123]: DEBUG oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Killing children. {{(pid=88123) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 07:21:10 devstack cinder-volume[88123]: INFO oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Waiting on 1 children to exit Jul 31 07:21:11 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Acquiring lock "singleton_lock" {{(pid=88343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 07:21:11 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Acquired lock "singleton_lock" {{(pid=88343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 07:21:11 devstack cinder-volume[88343]: DEBUG oslo_concurrency.lockutils [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Releasing lock "singleton_lock" {{(pid=88343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 07:21:11 devstack cinder-volume[88343]: WARNING amqp [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 07:21:11 devstack cinder-volume[88343]: WARNING amqp [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 07:21:11 devstack cinder-volume[88123]: INFO oslo_service.backend._eventlet.service [None req-f652c906-8931-4d73-b491-e2cd2d042d28 None None] Child 88343 exited with status 0 Jul 31 07:21:11 devstack cinder-volume[88619]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 07:21:11 devstack cinder-volume[88619]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 07:21:11 devstack cinder-volume[88619]: we strongly recommend against using it for new projects. Jul 31 07:21:11 devstack cinder-volume[88619]: If you are already using Eventlet, we recommend migrating to a different Jul 31 07:21:11 devstack cinder-volume[88619]: framework. For more detail see Jul 31 07:21:11 devstack cinder-volume[88619]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 07:21:11 devstack cinder-volume[88619]: import eventlet # noqa Jul 31 07:21:14 devstack cinder-volume[88619]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88619) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 07:21:14 devstack cinder-volume[88619]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88619) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 07:21:14 devstack cinder-volume[88619]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88619) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 07:21:15 devstack cinder-volume[88619]: INFO dbcounter [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Registered counter for database cinder Jul 31 07:21:15 devstack cinder-volume[88619]: DEBUG oslo_db.sqlalchemy.engines [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88619) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG dbcounter [-] [88619] Writer thread running {{(pid=88619) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 07:21:16 devstack cinder-volume[88619]: INFO cinder.rpc [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 07:21:16 devstack cinder-volume[88619]: INFO cinder.rpc [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_db.sqlalchemy.engines [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88619) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:16 devstack cinder-volume[88619]: INFO cinder.volume.manager [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Determined volume DB was empty at startup. Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG cinder.volume.manager [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88619) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 07:21:16 devstack cinder-volume[88619]: WARNING stevedore.named [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 07:21:16 devstack cinder-volume[88619]: WARNING castellan.key_manager [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 07:21:16 devstack cinder-volume[88619]: WARNING cinder.keymgr.conf_key_mgr [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 07:21:16 devstack cinder-volume[88619]: INFO cinder.volume.manager [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_db.sqlalchemy.engines [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88619) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:16 devstack cinder-volume[88619]: INFO oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Starting 1 workers Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Started child 88915 {{(pid=88619) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Full set of CONF: {{(pid=88619) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 07:21:16 devstack cinder-volume[88915]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] ******************************************************************************** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] Configuration options gathered from: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] ================================================================================ {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] allow_availability_zone_fallback = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] allow_compression_on_image_upload = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] allowed_direct_url_schemes = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] api_rate_limit = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] auth_strategy = keystone {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_host = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_stats_polling_interval = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backup_api_class = cinder.backup.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backup_name_template = backup-%s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backup_use_same_host = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backup_use_temp_snapshot = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] chap_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] chap_username = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_internal_tenant_project_id = 113c9d6903974dfa8bb7452443d647c2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_internal_tenant_user_id = 6df7f0f3a0174ee7b25ea2f324ad4f3a {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cluster = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] compression_format = gzip {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] compute_api_class = cinder.compute.nova.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] config_dir = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] config_source = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] control_exchange = openstack {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] debug = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] default_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] default_group_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] default_volume_type = QuobyteHD {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] disk_geometry = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] driver_client_cert = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] driver_client_cert_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] driver_data_namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] driver_ssl_cert_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] driver_ssl_cert_verify = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] driver_use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] enable_new_services = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] enable_unsupported_driver = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] enabled_backends = ['QuobyteHD'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] enforce_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] filter_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_api_insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_api_ssl_compression = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_ca_certificates_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_catalog_info = image:glance:publicURL {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_num_retries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance_request_timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] goodness_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] graceful_shutdown_timeout = 5 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] group_api_class = cinder.group.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] host = devstack {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_compress_on_upload = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_conversion_address_space_limit = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_conversion_cpu_limit = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_conversion_disable = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_upload_use_cinder_backend = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:16 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_upload_use_internal_tenant = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_volume_cache_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_volume_cache_max_count = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] image_volume_cache_max_size_gb = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Starting volume driver QuobyteDriver (1.2) Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] init_host_max_objects_retrieval = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] instance_format = [instance: %(uuid)s] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88915) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] iscsi_target_flags = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] iscsi_write_cache = on {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] iser_helper = tgtadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] iser_ip_address = 192.168.122.134 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] iser_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_color = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_config_append = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_dir = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_options = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_rotate_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_rotate_interval_type = days {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] log_rotation_type = none {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] max_age = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] max_logfile_count = 30 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] max_logfile_size_mb = 200 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] max_over_subscription_ratio = 20.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] message_reap_interval = 86400 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] message_ttl = 2592000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] migration_create_volume_timeout_secs = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] monkey_patch = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] monkey_patch_modules = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] my_ip = 192.168.122.134 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] no_snapshot_gb_quota = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] num_iser_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] num_shell_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] num_volume_device_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] nvmeof_conn_info_version = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] nvmet_ns_id = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] nvmet_port_id = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] osapi_max_limit = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] osapi_volume_ext_list = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] osapi_volume_listen_port = 8776 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] osapi_volume_use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] osapi_volume_workers = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] per_volume_size_limit = -1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] periodic_fuzzy_delay = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] periodic_interval = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] public_endpoint = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] publish_errors = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] quota_backup_gigabytes = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] quota_backups = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] quota_gigabytes = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] quota_groups = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] quota_snapshots = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] quota_volumes = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] rate_limit_burst = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] rate_limit_except_level = CRITICAL {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] rate_limit_interval = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] reinit_driver_count = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] replication_device = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] report_discard_supported = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] report_interval = 120 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] reservation_clean_interval = 86400 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] reservation_expire = 86400 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] reserved_image_namespaces = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] reserved_percentage = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] rpc_response_timeout = 120 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] run_external_periodic_tasks = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] scst_target_driver = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] scst_target_iqn_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_down_time = 720 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] shell_completion = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] snapshot_name_template = snapshot-%s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] state_path = /opt/stack/data/cinder {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] storage_availability_zone = nova {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] storage_protocol = iSCSI {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] syslog_log_facility = LOG_USER {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] target_helper = lioadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] target_ip_address = 192.168.122.134 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] target_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] target_protocol = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] target_secondary_ip_addresses = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] trace_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] transport_url = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] until_refresh = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] use_chap_auth = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] use_default_quota_class = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] use_journal = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] use_json = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] use_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] use_stderr = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] use_syslog = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] verify_glance_signatures = enabled {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_api_class = cinder.volume.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_backend_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_clear = zero {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_clear_ionice = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_clear_size = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_copy_bps_limit = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_dd_blocksize = 1M {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_name_template = volume-%s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_service_inithost_offload = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volume_usage_audit_period = month {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] zoning_mode = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_concurrency.disable_process_locking = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.auth_type = password {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.auth_version = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.cache = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.include_service_catalog = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.interface = public {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_password = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcache_username = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.region_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.service_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.backend = dogpile.cache.null {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.backend_argument = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.backend_expiration_time = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.config_prefix = cache.oslo {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.debug_cache_backend = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.enable_retry_client = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.enable_socket_keepalive = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.expiration_time = 600 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.hashclient_retry_attempts = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.memcache_dead_retry = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.memcache_pool_maxsize = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.memcache_sasl_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.proxies = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.redis_db = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.redis_server = localhost:6379 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.retry_attempts = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.retry_delay = 0.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.socket_keepalive_count = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.socket_keepalive_idle = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.socket_keepalive_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.socket_timeout = 1.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.tls_allowed_ciphers = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.tls_cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.tls_certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.tls_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.tls_keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cache.username = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] coordination.backend_url = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.asyncio_connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.asyncio_slave_connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.backend = sqlalchemy {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.connection_debug = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.connection_parameters = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.connection_recycle_time = 3600 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.connection_trace = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.db_inc_retry_interval = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.db_max_retries = 20 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.db_max_retry_interval = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.db_retry_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.max_overflow = 50 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.max_pool_size = 5 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.max_retries = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.mysql_wsrep_sync_wait = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.pool_timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.retry_interval = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.slave_connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.sqlite_synchronous = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.synchronous_reader = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] database.use_db_reconnect = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.connection_string = messaging:// {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.es_doc_type = notification {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.es_scroll_size = 10000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.es_scroll_time = 2m {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.filter_error_trace = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.hmac_keys = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.sentinel_service_name = mymaster {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.socket_timeout = 0.1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.trace_requests = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler.trace_sqlalchemy = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler_jaeger.process_tags = {} {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler_jaeger.service_name_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] profiler_otlp.service_name_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.enforce_new_defaults = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.policy_default_rule = default {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.policy_file = policy.yaml {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] privsep_osbrick.group = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] privsep_osbrick.helper_command = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] privsep_osbrick.user = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_sys_admin.group = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_sys_admin.helper_command = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] cinder_sys_admin.user = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88915) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 31 07:21:17 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 07:21:17 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.auth_type = password {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Running cmd (subprocess): mount.quobyte {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.send_service_user_token = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] service_user.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.auth_type = password {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.region_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] glance.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.backend_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.chap_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.chap_username = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.disk_geometry = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.driver_client_cert = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.driver_client_cert_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.driver_data_namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.driver_use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.extra_capabilities = {} {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.filter_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.goodness_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.iscsi_target_flags = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.iscsi_write_cache = on {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.iser_helper = tgtadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.iser_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_host = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_login = admin {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_mount_options = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_private_key = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_share_path = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.num_shell_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.quobyte_volume_url = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.replication_device = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.report_discard_supported = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.reserved_percentage = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.target_helper = tgtadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.target_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.target_protocol = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.trace_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.unique_fqdn_network = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.use_chap_auth = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_backend_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_clear = zero {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_clear_ionice = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_clear_size = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_reports.file_event_handler = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_reports.log_dir = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.backend_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.backend_host = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.chap_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.chap_username = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.chiscsi_conf = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.disk_geometry = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.driver_client_cert = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.driver_data_namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.driver_use_ssl = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.extra_capabilities = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.filter_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.goodness_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.iser_helper = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.iser_ip_address = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.iser_port = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.iser_target_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_host = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_login = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_mount_options = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_private_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_share_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_ssh_port = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.num_shell_tries = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.nvmet_port_id = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.replication_device = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.report_discard_supported = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.reserved_percentage = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.scst_target_driver = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.storage_protocol = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.target_helper = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.target_ip_address = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.target_port = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.target_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.target_protocol = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.trace_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.use_chap_auth = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_clear = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_clear_size = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] QuobyteHD.volumes_dir = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_notifications.driver = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_notifications.retry = -1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] key_manager.fixed_key = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.barbican_api_version = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.barbican_endpoint = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.barbican_endpoint_type = public {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.barbican_region_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.number_of_retries = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.retry_delay = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.send_service_user_token = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.verify_ssl = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican.verify_ssl_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.auth_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] barbican_service_user.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.approle_role_id = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.approle_secret_id = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.auth_method = approle {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.auth_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.kv_mountpoint = secret {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.kv_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.kv_version = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.root_token_id = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.ssl_ca_crt_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.timeout = 60.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.token_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.token_role = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 07:21:17 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-cad4c5c1-32a3-4ec2-a67f-c41677321260 None None] ******************************************************************************** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.333s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:17 devstack cinder-volume[88915]: INFO cinder.volume.driver [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Driver hasn't implemented _init_vendor_properties() Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.volume.driver [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540397644043, 'free_capacity_gb': 1775.7540397644043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88915) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_db.sqlalchemy.engines [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writer thread running {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.db.api [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Building query based on filter {{(pid=88915) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88915) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:21:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:17 devstack cinder-volume[88915]: INFO cinder.keymgr.migration [None req-d7ea0612-e568-4028-b6d4-1d9d5bc74ca0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 07:21:17 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:21:17 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:21:18 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.315s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:21:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Driver initialization completed successfully. Jul 31 07:21:18 devstack cinder-volume[88915]: INFO cinder.manager [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Initiating service 3 cleanup Jul 31 07:21:18 devstack cinder-volume[88915]: INFO cinder.manager [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Service 3 cleanup completed. Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG cinder.service [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Creating RPC server for service cinder-volume {{(pid=88915) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG cinder.service [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88915) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 07:21:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:21:18 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:21:18 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:21:18 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Jul 31 07:21:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:21:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a0ba0166-d9c1-4e35-af1f-1f1a3f61b74a None None] Driver post RPC initialization completed successfully. Jul 31 07:21:26 devstack cinder-volume[88619]: DEBUG dbcounter [-] [88619] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88619) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:21:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=3 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:21:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:21:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:21:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 6 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:21:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Flow 'volume_create_manager' (81763db4-03a9-43a8-a423-1ee7688547ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f06682b-8149-4578-8b0e-fde142a6b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f06682b-8149-4578-8b0e-fde142a6b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-695264503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a3a6f-c3ef-4a20-83fe-6a770708950f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23febd7c1c4493294ba7dd5cb93d6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:22:19Z,use_quota=True,user_id='2e23ead425794d7a871243d4b1d69d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b29d5b5-0f7b-47cf-9471-f5e1b9f8e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b29d5b5-0f7b-47cf-9471-f5e1b9f8e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a62755d-9177-48cb-a28f-3dc1b193ce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a62755d-9177-48cb-a28f-3dc1b193ce90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17a3a6f-c3ef-4a20-83fe-6a770708950f', 'volume_name': 'volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011a2e64-aaed-470b-aada-cec39b8d4696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011a2e64-aaed-470b-aada-cec39b8d4696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed2aad-0d65-4d5d-b6c6-e3c138d20cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Volume e17a3a6f-c3ef-4a20-83fe-6a770708950f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f', 'volume_size': 1} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-695264503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a3a6f-c3ef-4a20-83fe-6a770708950f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23febd7c1c4493294ba7dd5cb93d6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:22:19Z,use_quota=True,user_id='2e23ead425794d7a871243d4b1d69d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Creating volume e17a3a6f-c3ef-4a20-83fe-6a770708950f {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:22:19 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:22:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:22:19 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f 1073741824 Jul 31 07:22:19 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:22:20 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Jul 31 07:22:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f 1073741824" returned: 0 in 1.081s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:22:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:22:20 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f Jul 31 07:22:20 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:22:21 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Jul 31 07:22:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f" returned: 0 in 0.348s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:22:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:22:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed2aad-0d65-4d5d-b6c6-e3c138d20cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdfb380-1183-4764-9f4a-5d833a447358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:21 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Volume volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f (e17a3a6f-c3ef-4a20-83fe-6a770708950f): created successfully Jul 31 07:22:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdfb380-1183-4764-9f4a-5d833a447358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Flow 'volume_create_manager' (81763db4-03a9-43a8-a423-1ee7688547ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:22:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2e7292d2-11bb-43f2-9eda-bc82783e2f06 tempest-TaggedAttachmentsTest-1596666067 None] Created volume successfully. Jul 31 07:22:31 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:22:31 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:22:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:22:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:22:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:22:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:22:33 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:22:33 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:22:34 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Jul 31 07:22:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.701s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:22:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:22:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:22:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 6 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:22:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Flow 'volume_create_manager' (bc772260-adb3-41cb-9246-0fd17bdb17d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7babddd8-bd69-4402-8a00-ed84619ecbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7babddd8-bd69-4402-8a00-ed84619ecbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1994939080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93bd14c-0708-48b0-bf8a-eb990dae97d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58ad7e7b8a043f493905804618aa929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:22:47Z,use_quota=True,user_id='1761fae9bf374b35bf5eb370b0f5dcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2dd5e6-7847-4298-99d9-0d3e265dc759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2dd5e6-7847-4298-99d9-0d3e265dc759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39da9e70-32b5-4763-b313-42d8d1b548ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39da9e70-32b5-4763-b313-42d8d1b548ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93bd14c-0708-48b0-bf8a-eb990dae97d4', 'volume_name': 'volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea6275f-a1a3-4ae5-8278-e36f19df660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea6275f-a1a3-4ae5-8278-e36f19df660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6ee27a-50a8-4ed0-9d24-935b7baab583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Volume e93bd14c-0708-48b0-bf8a-eb990dae97d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4', 'volume_size': 1} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1994939080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93bd14c-0708-48b0-bf8a-eb990dae97d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58ad7e7b8a043f493905804618aa929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:22:47Z,use_quota=True,user_id='1761fae9bf374b35bf5eb370b0f5dcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Creating volume e93bd14c-0708-48b0-bf8a-eb990dae97d4 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:22:46 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:22:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:22:46 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 1073741824 Jul 31 07:22:46 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:22:47 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Jul 31 07:22:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 1073741824" returned: 0 in 0.742s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:22:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:22:47 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 Jul 31 07:22:47 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:22:48 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4" returned: 0 in 0.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6ee27a-50a8-4ed0-9d24-935b7baab583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d57116b-c549-4953-aea9-bf5b91320895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:48 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Volume volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 (e93bd14c-0708-48b0-bf8a-eb990dae97d4): created successfully Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d57116b-c549-4953-aea9-bf5b91320895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Flow 'volume_create_manager' (bc772260-adb3-41cb-9246-0fd17bdb17d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:22:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9a9be9e7-2cdb-4877-9453-7d59983f033c tempest-ServerActionsTestOtherA-889194416 None] Created volume successfully. Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Flow 'volume_create_manager' (aa7b0308-1f63-4fb7-a989-c4789ff1a705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:22:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323df56d-3ab5-4673-8a2d-48e79f4a4f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323df56d-3ab5-4673-8a2d-48e79f4a4f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1651594163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cbcf00-cd4c-4927-895b-3bf0d5926c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dce1f1cca446a4bfc6c4fc6d429c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:22:49Z,use_quota=True,user_id='b25d5808e7c8464fa26dd516178473b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1328f938-2804-4b60-ab6b-51edb8330196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1328f938-2804-4b60-ab6b-51edb8330196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6189df08-764f-447c-8673-34555dd9f529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6189df08-764f-447c-8673-34555dd9f529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cbcf00-cd4c-4927-895b-3bf0d5926c3c', 'volume_name': 'volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3325dc1a-f95a-460b-8ae9-8bcbb51a2877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3325dc1a-f95a-460b-8ae9-8bcbb51a2877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ae1b87-d4ca-49fb-83ac-bbf907bf586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:49 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Volume 33cbcf00-cd4c-4927-895b-3bf0d5926c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c', 'volume_size': 1} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1651594163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cbcf00-cd4c-4927-895b-3bf0d5926c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dce1f1cca446a4bfc6c4fc6d429c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:22:49Z,use_quota=True,user_id='b25d5808e7c8464fa26dd516178473b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Creating volume 33cbcf00-cd4c-4927-895b-3bf0d5926c3c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:22:49 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:22:49 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c 1073741824 Jul 31 07:22:49 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:22:49 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c 1073741824" returned: 0 in 0.559s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:22:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:22:49 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c Jul 31 07:22:49 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:22:50 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Jul 31 07:22:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c" returned: 0 in 0.510s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:22:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:22:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ae1b87-d4ca-49fb-83ac-bbf907bf586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20663962-faa2-401d-9449-ad38f2d806b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:22:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Volume volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c (33cbcf00-cd4c-4927-895b-3bf0d5926c3c): created successfully Jul 31 07:22:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20663962-faa2-401d-9449-ad38f2d806b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:22:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Flow 'volume_create_manager' (aa7b0308-1f63-4fb7-a989-c4789ff1a705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:22:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-eea36b37-7192-41c7-b8d5-f3103a268761 tempest-AttachVolumeTestJSON-1457365710 None] Created volume successfully. Jul 31 07:22:55 devstack cinder-volume[88915]: WARNING py.warnings [req-cfb0552a-79d7-40d6-a8ab-118414595641 req-0675ffce-05db-4a44-8fc9-eee4932714e9 tempest-AttachVolumeTestJSON-1457365710 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 31 07:22:55 devstack cinder-volume[88915]: .first() Jul 31 07:22:55 devstack cinder-volume[88915]: Jul 31 07:22:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cfb0552a-79d7-40d6-a8ab-118414595641 req-0675ffce-05db-4a44-8fc9-eee4932714e9 tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:22:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cfb0552a-79d7-40d6-a8ab-118414595641 req-0675ffce-05db-4a44-8fc9-eee4932714e9 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:22:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cfb0552a-79d7-40d6-a8ab-118414595641 req-0675ffce-05db-4a44-8fc9-eee4932714e9 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:22:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cfb0552a-79d7-40d6-a8ab-118414595641 req-0675ffce-05db-4a44-8fc9-eee4932714e9 tempest-AttachVolumeTestJSON-1457365710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c913b6c-aa7e-4d6d-9463-6453864f9d3c', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:22:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-cfb0552a-79d7-40d6-a8ab-118414595641 req-0675ffce-05db-4a44-8fc9-eee4932714e9 tempest-AttachVolumeTestJSON-1457365710 None] attachment_update completed successfully. Jul 31 07:23:05 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:23:05 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=9,cinder:SELECT=11 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:23:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-b236780f-54a8-4487-b19b-74d1894a0925 req-757de7b0-3565-4459-a470-a5110b9d0497 tempest-TaggedAttachmentsTest-1596666067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-b236780f-54a8-4487-b19b-74d1894a0925 req-757de7b0-3565-4459-a470-a5110b9d0497 tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-b236780f-54a8-4487-b19b-74d1894a0925 req-757de7b0-3565-4459-a470-a5110b9d0497 tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-b236780f-54a8-4487-b19b-74d1894a0925 req-757de7b0-3565-4459-a470-a5110b9d0497 tempest-TaggedAttachmentsTest-1596666067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c550a1d-0c3d-48c6-be2b-b6275e3771ad', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:23:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-b236780f-54a8-4487-b19b-74d1894a0925 req-757de7b0-3565-4459-a470-a5110b9d0497 tempest-TaggedAttachmentsTest-1596666067 None] attachment_update completed successfully. Jul 31 07:23:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-b52968a9-b667-449d-9f35-e7888ddb466c req-370f0479-20a7-4ea8-b909-0bac97a713c1 tempest-TaggedAttachmentsTest-1596666067 None] Terminate volume connection completed successfully. Jul 31 07:23:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-b52968a9-b667-449d-9f35-e7888ddb466c req-370f0479-20a7-4ea8-b909-0bac97a713c1 tempest-TaggedAttachmentsTest-1596666067 None] Deleting attachment 9c550a1d-0c3d-48c6-be2b-b6275e3771ad. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:23:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-e06c2424-9b88-4d01-9f26-68193dd54c6d req-ad912e88-fc2c-40f8-a015-6e8b567b72bd tempest-ServerActionsTestOtherA-889194416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-e06c2424-9b88-4d01-9f26-68193dd54c6d req-ad912e88-fc2c-40f8-a015-6e8b567b72bd tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-e06c2424-9b88-4d01-9f26-68193dd54c6d req-ad912e88-fc2c-40f8-a015-6e8b567b72bd tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-e06c2424-9b88-4d01-9f26-68193dd54c6d req-ad912e88-fc2c-40f8-a015-6e8b567b72bd tempest-ServerActionsTestOtherA-889194416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '718c6893-0e3c-4b94-8e57-f27f19d924d1', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:23:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-e06c2424-9b88-4d01-9f26-68193dd54c6d req-ad912e88-fc2c-40f8-a015-6e8b567b72bd tempest-ServerActionsTestOtherA-889194416 None] attachment_update completed successfully. Jul 31 07:23:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-dd681e45-f031-43d0-af83-a8fb665b77d9 req-34c9246b-9e0a-4b92-97fa-ce8fde08a73a tempest-ServerActionsTestOtherA-889194416 None] Terminate volume connection completed successfully. Jul 31 07:23:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-dd681e45-f031-43d0-af83-a8fb665b77d9 req-34c9246b-9e0a-4b92-97fa-ce8fde08a73a tempest-ServerActionsTestOtherA-889194416 None] Deleting attachment 718c6893-0e3c-4b94-8e57-f27f19d924d1. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:23:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-dd681e45-f031-43d0-af83-a8fb665b77d9 req-7f294b90-b5df-4251-af26-f9019f7692b8 tempest-ServerActionsTestOtherA-889194416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-dd681e45-f031-43d0-af83-a8fb665b77d9 req-7f294b90-b5df-4251-af26-f9019f7692b8 tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-dd681e45-f031-43d0-af83-a8fb665b77d9 req-7f294b90-b5df-4251-af26-f9019f7692b8 tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-dd681e45-f031-43d0-af83-a8fb665b77d9 req-7f294b90-b5df-4251-af26-f9019f7692b8 tempest-ServerActionsTestOtherA-889194416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25985b22-7cc7-457d-80ed-10b3c82f80de', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:23:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-dd681e45-f031-43d0-af83-a8fb665b77d9 req-7f294b90-b5df-4251-af26-f9019f7692b8 tempest-ServerActionsTestOtherA-889194416 None] attachment_update completed successfully. Jul 31 07:23:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:23:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:23:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:23:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:33 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:23:33 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:34 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.344s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:23:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-735a74ab-a441-4257-9421-87b19aa92d7e req-b586ab95-995b-48f2-a05e-39e7b1ef1504 tempest-AttachVolumeTestJSON-1457365710 None] Terminate volume connection completed successfully. Jul 31 07:23:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-735a74ab-a441-4257-9421-87b19aa92d7e req-b586ab95-995b-48f2-a05e-39e7b1ef1504 tempest-AttachVolumeTestJSON-1457365710 None] Deleting attachment 4c913b6c-aa7e-4d6d-9463-6453864f9d3c. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:23:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Acquiring lock "cinder-e17a3a6f-c3ef-4a20-83fe-6a770708950f-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:23:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Lock "cinder-e17a3a6f-c3ef-4a20-83fe-6a770708950f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:23:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Acquiring lock "cinder-quobyte-e17a3a6f-c3ef-4a20-83fe-6a770708950f" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:23:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Lock "cinder-quobyte-e17a3a6f-c3ef-4a20-83fe-6a770708950f" acquired by "delete_volume" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:23:38 devstack cinder-volume[88915]: INFO oslo.privsep.daemon [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfvceoa5o/privsep.sock'] Jul 31 07:23:38 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfvceoa5o/privsep.sock Jul 31 07:23:38 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 07:23:39 devstack cinder-volume[88915]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 31 07:23:39 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:39 devstack cinder-volume[88915]: INFO oslo.privsep.daemon [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Spawned new privsep daemon via rootwrap Jul 31 07:23:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Accepted privsep connection to /tmp/tmpfvceoa5o/privsep.sock {{(pid=88915) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 31 07:23:39 devstack cinder-volume[88915]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 31 07:23:39 devstack cinder-volume[88915]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 31 07:23:39 devstack cinder-volume[88915]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 31 07:23:39 devstack cinder-volume[88915]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91866 Jul 31 07:23:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940a3c9-c650-4a71-ae48-60d7ae345dfe]: (2,) {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:23:40 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[119421ca-13e0-48f9-b0f8-d3f7e763f57b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:23:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:40 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f Jul 31 07:23:40 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:41 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f" returned: 0 in 1.124s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:41 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f Jul 31 07:23:41 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:41 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e17a3a6f-c3ef-4a20-83fe-6a770708950f" returned: 0 in 0.407s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Lock "cinder-quobyte-e17a3a6f-c3ef-4a20-83fe-6a770708950f" released by "delete_volume" :: held 3.575s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:23:41 devstack cinder-volume[88915]: WARNING cinder.quota [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:23:41 devstack cinder-volume[88915]: WARNING cinder.quota [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Created reservations ['13686cf7-3503-49b7-857f-6901023c500c', 'a29ed261-be08-444c-b90a-dc0da649a165', 'b2455dd9-61e9-40e9-9abf-429c3946a89a', '93547a16-1847-474d-a27e-1499c87f3448'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:41 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:23:41 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:42 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.548s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:42 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:23:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Deleted volume successfully. Jul 31 07:23:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3709b75d-4bfd-426e-be79-782e0a761e5d tempest-TaggedAttachmentsTest-1596666067 None] Lock "cinder-e17a3a6f-c3ef-4a20-83fe-6a770708950f-delete_volume" released by "delete_volume" :: held 4.626s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Flow 'volume_create_manager' (ce902cac-9b26-410f-bbf9-3035df5b4d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d08e0dd-5cce-4e4d-affe-b82a3be978cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d08e0dd-5cce-4e4d-affe-b82a3be978cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1413674483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4536cde-f561-4ff9-bd91-b5ffdbbc2568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d27a335c0646c296c305d2ccfe939b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:23:45Z,use_quota=True,user_id='b247db5bea83461aba7d96528115c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e3a95-774c-4ac9-b7de-c55ae4d9450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e3a95-774c-4ac9-b7de-c55ae4d9450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33f0f1-02c4-4723-837a-d1f20bf9d23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33f0f1-02c4-4723-837a-d1f20bf9d23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4536cde-f561-4ff9-bd91-b5ffdbbc2568', 'volume_name': 'volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e113d38-fb5c-41e9-81b1-b1dc7af33b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:23:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e113d38-fb5c-41e9-81b1-b1dc7af33b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040f5a33-413f-4c59-8780-1d959cbfbd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:23:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Volume c4536cde-f561-4ff9-bd91-b5ffdbbc2568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568', 'volume_size': 1} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1413674483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4536cde-f561-4ff9-bd91-b5ffdbbc2568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d27a335c0646c296c305d2ccfe939b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:23:45Z,use_quota=True,user_id='b247db5bea83461aba7d96528115c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Creating volume c4536cde-f561-4ff9-bd91-b5ffdbbc2568 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:23:45 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:45 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 1073741824 Jul 31 07:23:45 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:45 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 1073741824" returned: 0 in 0.683s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:45 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 Jul 31 07:23:45 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:46 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568" returned: 0 in 0.509s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:23:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040f5a33-413f-4c59-8780-1d959cbfbd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:23:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ceba230-110a-442d-acaa-edb16f2b0136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:23:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Volume volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 (c4536cde-f561-4ff9-bd91-b5ffdbbc2568): created successfully Jul 31 07:23:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ceba230-110a-442d-acaa-edb16f2b0136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:23:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Flow 'volume_create_manager' (ce902cac-9b26-410f-bbf9-3035df5b4d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:23:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8e808be9-d4c2-460e-bb28-fc594f1013c3 tempest-VolumesAdminNegativeTest-149790768 None] Created volume successfully. Jul 31 07:23:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Acquiring lock "cinder-c4536cde-f561-4ff9-bd91-b5ffdbbc2568-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:23:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Lock "cinder-c4536cde-f561-4ff9-bd91-b5ffdbbc2568-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:23:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Acquiring lock "cinder-quobyte-c4536cde-f561-4ff9-bd91-b5ffdbbc2568" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:23:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Lock "cinder-quobyte-c4536cde-f561-4ff9-bd91-b5ffdbbc2568" acquired by "delete_volume" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:23:48 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ee119-454c-40f0-a462-59e6db1f2121]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:23:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:48 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 Jul 31 07:23:48 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:48 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568" returned: 0 in 0.592s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:48 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568 Jul 31 07:23:48 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:49 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c4536cde-f561-4ff9-bd91-b5ffdbbc2568" returned: 0 in 0.584s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Lock "cinder-quobyte-c4536cde-f561-4ff9-bd91-b5ffdbbc2568" released by "delete_volume" :: held 1.288s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Created reservations ['ef68ef0b-fa4a-4da0-98cd-489d43b70b28', 'c27bfc3f-9e1a-4108-a869-5dd69a2b972e', '8f03d201-deaa-435b-a061-30feb676eccd', '81854111-81de-49ca-9f14-6ae3b06fb238'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:23:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:23:49 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:23:49 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:23:50 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jul 31 07:23:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.604s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:23:50 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:23:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Deleted volume successfully. Jul 31 07:23:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2dab3ce1-9df9-4f55-9fce-dc5c606b473b tempest-VolumesAdminNegativeTest-149790768 None] Lock "cinder-c4536cde-f561-4ff9-bd91-b5ffdbbc2568-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:23:59 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=24,cinder:SELECT=36,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:24:00 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=34,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:24:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-5f412683-a984-47ab-9a54-1717bd0c822a req-54923958-74f3-48e2-a73d-90d728b88cbe tempest-ServerActionsTestOtherA-889194416 None] Terminate volume connection completed successfully. Jul 31 07:24:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-5f412683-a984-47ab-9a54-1717bd0c822a req-54923958-74f3-48e2-a73d-90d728b88cbe tempest-ServerActionsTestOtherA-889194416 None] Deleting attachment 25985b22-7cc7-457d-80ed-10b3c82f80de. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:24:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Acquiring lock "cinder-e93bd14c-0708-48b0-bf8a-eb990dae97d4-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:24:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Lock "cinder-e93bd14c-0708-48b0-bf8a-eb990dae97d4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:24:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Acquiring lock "cinder-quobyte-e93bd14c-0708-48b0-bf8a-eb990dae97d4" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:24:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Lock "cinder-quobyte-e93bd14c-0708-48b0-bf8a-eb990dae97d4" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:24:12 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb36c3-3825-46b8-b039-e01437a3bff2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:24:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:24:12 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 Jul 31 07:24:12 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:24:13 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4" returned: 0 in 0.543s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:24:13 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4 Jul 31 07:24:13 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:24:13 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e93bd14c-0708-48b0-bf8a-eb990dae97d4" returned: 0 in 0.396s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Lock "cinder-quobyte-e93bd14c-0708-48b0-bf8a-eb990dae97d4" released by "delete_volume" :: held 1.030s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Created reservations ['ef69f7ac-7b1b-4e41-9ee4-2884655539e1', '771d6842-1a00-43e0-8aad-aa2f4c6bcc5c', '1e4bb463-7c6f-4d5a-8d2a-ce4417c73dbd', '9c6d7e93-8828-4107-8084-9935f8b342ad'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:24:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:24:13 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:24:13 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:24:14 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 31 07:24:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.349s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:24:14 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:24:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Deleted volume successfully. Jul 31 07:24:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-657a036d-fbe6-441f-ad2f-f498f623645a tempest-ServerActionsTestOtherA-889194416 None] Lock "cinder-e93bd14c-0708-48b0-bf8a-eb990dae97d4-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:24:23 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:24:24 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:24:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:24:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:24:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:24:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:24:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:24:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:24:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:24:33 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:24:33 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:24:34 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 31 07:24:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.731s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:24:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:24:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:24:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 8 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:24:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:24:55 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Flow 'volume_create_manager' (0a657959-3053-4b52-95ba-95b912433b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6925c92f-d5a6-4dd8-bce0-8038eb788320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6925c92f-d5a6-4dd8-bce0-8038eb788320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1854816689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada404e0-a8f6-4908-a106-a104768bf4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5723d555c424e0793da51f73d9acfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:24:56Z,use_quota=True,user_id='7f0127c03f5646658e38f6424846bbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2571658c-06a9-44be-8539-3b7976ac5133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2571658c-06a9-44be-8539-3b7976ac5133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a017c251-915e-41a9-b4da-42ca3dd7a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a017c251-915e-41a9-b4da-42ca3dd7a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada404e0-a8f6-4908-a106-a104768bf4e5', 'volume_name': 'volume-ada404e0-a8f6-4908-a106-a104768bf4e5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0a1bbc-97e4-40b7-8eef-504088198308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0a1bbc-97e4-40b7-8eef-504088198308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93560f22-9026-4c4d-84d3-deee387b1d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:24:56 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Volume ada404e0-a8f6-4908-a106-a104768bf4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada404e0-a8f6-4908-a106-a104768bf4e5', 'volume_size': 1} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1854816689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada404e0-a8f6-4908-a106-a104768bf4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5723d555c424e0793da51f73d9acfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:24:56Z,use_quota=True,user_id='7f0127c03f5646658e38f6424846bbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Creating volume ada404e0-a8f6-4908-a106-a104768bf4e5 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:24:56 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:24:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:24:56 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 1073741824 Jul 31 07:24:56 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:24:57 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 31 07:24:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 1073741824" returned: 0 in 0.862s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:24:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:24:57 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 Jul 31 07:24:57 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:24:57 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 31 07:24:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5" returned: 0 in 0.825s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:24:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:24:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:24:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93560f22-9026-4c4d-84d3-deee387b1d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada404e0-a8f6-4908-a106-a104768bf4e5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:24:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bba6c1-cd9d-4376-a9b6-77d02436928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:24:58 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Volume volume-ada404e0-a8f6-4908-a106-a104768bf4e5 (ada404e0-a8f6-4908-a106-a104768bf4e5): created successfully Jul 31 07:24:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bba6c1-cd9d-4376-a9b6-77d02436928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:24:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Flow 'volume_create_manager' (0a657959-3053-4b52-95ba-95b912433b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:24:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-496b728f-9a85-466d-bbaf-32a32eb03638 tempest-DeleteServersTestJSON-707306027 None] Created volume successfully. Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Flow 'volume_create_manager' (55547969-9f63-4bd9-8e61-a585a15037b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f61e23a-c607-46e4-bdc4-9838047553ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f61e23a-c607-46e4-bdc4-9838047553ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-950770114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b547ffeb-f773-4fca-93ba-af3af9bcd36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2521ab54b8794522a5ae20de6c616e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:01Z,use_quota=True,user_id='d8ac7fd66a5d45bd823a37a247cfb9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ff9a7d-ebf2-41cc-a3f6-d8a2b56a6624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ff9a7d-ebf2-41cc-a3f6-d8a2b56a6624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ed893-da6e-4f93-a311-c95f4d23a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ed893-da6e-4f93-a311-c95f4d23a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b547ffeb-f773-4fca-93ba-af3af9bcd36d', 'volume_name': 'volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b300e9ca-a38b-48fb-84a4-51029b6bb215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b300e9ca-a38b-48fb-84a4-51029b6bb215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e44b57-d1f4-4148-b869-9c9feca3341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:01 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Volume b547ffeb-f773-4fca-93ba-af3af9bcd36d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d', 'volume_size': 1} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-950770114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b547ffeb-f773-4fca-93ba-af3af9bcd36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2521ab54b8794522a5ae20de6c616e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:01Z,use_quota=True,user_id='d8ac7fd66a5d45bd823a37a247cfb9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Creating volume b547ffeb-f773-4fca-93ba-af3af9bcd36d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:25:01 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:01 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d 1073741824 Jul 31 07:25:01 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-65494c57-08dc-40be-9811-2d6d77663348 req-347b6952-6f17-4296-9397-270ccf0a5312 tempest-DeleteServersTestJSON-707306027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:02 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d 1073741824" returned: 0 in 1.072s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:02 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d Jul 31 07:25:02 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:03 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d" returned: 0 in 0.545s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-65494c57-08dc-40be-9811-2d6d77663348 req-347b6952-6f17-4296-9397-270ccf0a5312 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.577s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e44b57-d1f4-4148-b869-9c9feca3341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c645df-bc9e-4e33-a84e-4cce1b53a427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:03 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Volume volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d (b547ffeb-f773-4fca-93ba-af3af9bcd36d): created successfully Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c645df-bc9e-4e33-a84e-4cce1b53a427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Flow 'volume_create_manager' (55547969-9f63-4bd9-8e61-a585a15037b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-65494c57-08dc-40be-9811-2d6d77663348 req-347b6952-6f17-4296-9397-270ccf0a5312 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.188s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3229df08-12b6-4437-a02d-b83a5bc20862 tempest-ServerRescueNegativeTestJSON-24517726 None] Created volume successfully. Jul 31 07:25:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-65494c57-08dc-40be-9811-2d6d77663348 req-347b6952-6f17-4296-9397-270ccf0a5312 tempest-DeleteServersTestJSON-707306027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-ada404e0-a8f6-4908-a106-a104768bf4e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44061ceb-d963-480c-a366-66942c9cfef7', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:25:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-65494c57-08dc-40be-9811-2d6d77663348 req-347b6952-6f17-4296-9397-270ccf0a5312 tempest-DeleteServersTestJSON-707306027 None] attachment_update completed successfully. Jul 31 07:25:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-66ffa010-2560-44d2-8200-8826de5f72ae req-f58e803b-6e17-4b3d-befe-f617ac3ff6c9 tempest-DeleteServersTestJSON-707306027 None] Terminate volume connection completed successfully. Jul 31 07:25:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-66ffa010-2560-44d2-8200-8826de5f72ae req-f58e803b-6e17-4b3d-befe-f617ac3ff6c9 tempest-DeleteServersTestJSON-707306027 None] Deleting attachment 44061ceb-d963-480c-a366-66942c9cfef7. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:25:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Acquiring lock "cinder-ada404e0-a8f6-4908-a106-a104768bf4e5-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Lock "cinder-ada404e0-a8f6-4908-a106-a104768bf4e5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Acquiring lock "cinder-quobyte-ada404e0-a8f6-4908-a106-a104768bf4e5" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Lock "cinder-quobyte-ada404e0-a8f6-4908-a106-a104768bf4e5" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:12 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb1949-78bb-49ef-95c3-8b220b1316b2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:25:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:13 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 Jul 31 07:25:13 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:13 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5" returned: 0 in 0.706s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:13 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5 Jul 31 07:25:13 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:14 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ada404e0-a8f6-4908-a106-a104768bf4e5" returned: 0 in 0.375s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Lock "cinder-quobyte-ada404e0-a8f6-4908-a106-a104768bf4e5" released by "delete_volume" :: held 1.146s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Created reservations ['90f41465-dc5d-442a-a327-7743f92983f3', 'e2cb4c5f-073c-46a9-ae88-674a21c809af', '8121104a-f8b9-4447-8c9d-25b68f46f7c4', '78f30ad4-a9d0-4f15-a28c-71ee8090343e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:14 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:14 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:14 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.626s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:14 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Deleted volume successfully. Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-714815a1-2849-4bda-a4b6-8f3a14c213f4 tempest-DeleteServersTestJSON-707306027 None] Lock "cinder-ada404e0-a8f6-4908-a106-a104768bf4e5-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Flow 'volume_create_manager' (f872363e-d4ff-4e4d-b2dc-34676e78245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3bf49-04e2-44af-a2f6-6bf012810609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3bf49-04e2-44af-a2f6-6bf012810609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1726195700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75bdb88-3ce2-4e73-87b5-f084db1bbc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dce1f1cca446a4bfc6c4fc6d429c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:16Z,use_quota=True,user_id='b25d5808e7c8464fa26dd516178473b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a345bbf-f3fd-436d-9ac0-7d46f66ea2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a345bbf-f3fd-436d-9ac0-7d46f66ea2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bc3de1-4da6-4dc6-8ee2-d42ac5a86701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bc3de1-4da6-4dc6-8ee2-d42ac5a86701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75bdb88-3ce2-4e73-87b5-f084db1bbc92', 'volume_name': 'volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a07e97-8d96-42eb-a4a4-dfec592e90ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a07e97-8d96-42eb-a4a4-dfec592e90ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda9bfa2-863e-43b6-a140-2a97da79d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Volume f75bdb88-3ce2-4e73-87b5-f084db1bbc92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92', 'volume_size': 1} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1726195700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75bdb88-3ce2-4e73-87b5-f084db1bbc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dce1f1cca446a4bfc6c4fc6d429c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:16Z,use_quota=True,user_id='b25d5808e7c8464fa26dd516178473b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Creating volume f75bdb88-3ce2-4e73-87b5-f084db1bbc92 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:25:15 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:25:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:15 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 1073741824 Jul 31 07:25:15 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:16 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 1073741824" returned: 0 in 0.865s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:16 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 Jul 31 07:25:16 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:17 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92" returned: 0 in 0.539s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:25:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda9bfa2-863e-43b6-a140-2a97da79d052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33632144-0818-42ca-9a25-16eb81f18b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:17 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Volume volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 (f75bdb88-3ce2-4e73-87b5-f084db1bbc92): created successfully Jul 31 07:25:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33632144-0818-42ca-9a25-16eb81f18b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Flow 'volume_create_manager' (f872363e-d4ff-4e4d-b2dc-34676e78245b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-425a0106-4f7e-4bbe-b219-92eb93350e55 tempest-AttachVolumeTestJSON-1457365710 None] Created volume successfully. Jul 31 07:25:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Acquiring lock "cinder-b547ffeb-f773-4fca-93ba-af3af9bcd36d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "cinder-b547ffeb-f773-4fca-93ba-af3af9bcd36d-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Acquiring lock "cinder-quobyte-b547ffeb-f773-4fca-93ba-af3af9bcd36d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "cinder-quobyte-b547ffeb-f773-4fca-93ba-af3af9bcd36d" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:20 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c31e850-9dfc-4a1e-992b-088e31d26d2b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:25:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:21 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d Jul 31 07:25:21 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-a7dfaa4f-1ae6-4380-a4e6-a0eaf8808a94 req-0576f99c-2c64-4bb6-9843-743de69868f3 tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-a7dfaa4f-1ae6-4380-a4e6-a0eaf8808a94 req-0576f99c-2c64-4bb6-9843-743de69868f3 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-a7dfaa4f-1ae6-4380-a4e6-a0eaf8808a94 req-0576f99c-2c64-4bb6-9843-743de69868f3 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-a7dfaa4f-1ae6-4380-a4e6-a0eaf8808a94 req-0576f99c-2c64-4bb6-9843-743de69868f3 tempest-AttachVolumeTestJSON-1457365710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67450725-a307-43a6-9879-1b7e613c394d', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:25:21 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d" returned: 0 in 1.264s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-a7dfaa4f-1ae6-4380-a4e6-a0eaf8808a94 req-0576f99c-2c64-4bb6-9843-743de69868f3 tempest-AttachVolumeTestJSON-1457365710 None] attachment_update completed successfully. Jul 31 07:25:22 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d Jul 31 07:25:22 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:22 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b547ffeb-f773-4fca-93ba-af3af9bcd36d" returned: 0 in 0.688s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "cinder-quobyte-b547ffeb-f773-4fca-93ba-af3af9bcd36d" released by "delete_volume" :: held 2.119s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:22 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Created reservations ['e2aed383-9675-4f4c-97ea-6b353eca38cd', '88f2be58-f4fb-4478-b3f9-b4bb5b91992b', 'b363fdc4-7043-4386-bcfc-57647f98fb07', '9cba77a1-d9e4-4619-9f28-45a9b37c4194'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:23 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:23 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:23 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.661s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:23 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Deleted volume successfully. Jul 31 07:25:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3f6c6e98-5723-4079-b068-038fe12c21a6 tempest-ServerRescueNegativeTestJSON-24517726 None] Lock "cinder-b547ffeb-f773-4fca-93ba-af3af9bcd36d-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Flow 'volume_create_manager' (082fd190-7e65-4637-914c-25241b32176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b745b54-81c5-4959-b9b8-fa56b89de9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b745b54-81c5-4959-b9b8-fa56b89de9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1806102477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b70eec9-a8a7-4f3b-9617-a3394f265fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dce1f1cca446a4bfc6c4fc6d429c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:29Z,use_quota=True,user_id='b25d5808e7c8464fa26dd516178473b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd53179e-39ab-47cf-84c5-8b7bf5ae2fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd53179e-39ab-47cf-84c5-8b7bf5ae2fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b268f7ca-870c-4e4a-a3bc-9ff39697d6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b268f7ca-870c-4e4a-a3bc-9ff39697d6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b70eec9-a8a7-4f3b-9617-a3394f265fd5', 'volume_name': 'volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61a3cb7-8b71-4896-968a-510264f8d3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61a3cb7-8b71-4896-968a-510264f8d3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f960afda-a61f-41bd-9a54-05875174174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:28 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Volume 8b70eec9-a8a7-4f3b-9617-a3394f265fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5', 'volume_size': 1} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1806102477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b70eec9-a8a7-4f3b-9617-a3394f265fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8dce1f1cca446a4bfc6c4fc6d429c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:29Z,use_quota=True,user_id='b25d5808e7c8464fa26dd516178473b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Creating volume 8b70eec9-a8a7-4f3b-9617-a3394f265fd5 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:25:28 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:25:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:28 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 1073741824 Jul 31 07:25:28 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:29 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 1073741824" returned: 0 in 1.090s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:29 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 Jul 31 07:25:29 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:30 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5" returned: 0 in 0.511s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:25:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f960afda-a61f-41bd-9a54-05875174174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc4b594-9fab-4b5b-979f-74012e383eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:30 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Volume volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 (8b70eec9-a8a7-4f3b-9617-a3394f265fd5): created successfully Jul 31 07:25:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc4b594-9fab-4b5b-979f-74012e383eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Flow 'volume_create_manager' (082fd190-7e65-4637-914c-25241b32176b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4c023013-0122-4501-aa90-5f6422826efb tempest-AttachVolumeTestJSON-1457365710 None] Created volume successfully. Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-0e98b890-a329-49a8-9a65-f2fee17ea891 req-e58ed15b-1539-489c-bb1a-03a096e1b1d4 tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-0e98b890-a329-49a8-9a65-f2fee17ea891 req-e58ed15b-1539-489c-bb1a-03a096e1b1d4 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-0e98b890-a329-49a8-9a65-f2fee17ea891 req-e58ed15b-1539-489c-bb1a-03a096e1b1d4 tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-0e98b890-a329-49a8-9a65-f2fee17ea891 req-e58ed15b-1539-489c-bb1a-03a096e1b1d4 tempest-AttachVolumeTestJSON-1457365710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '454dd8af-01fa-458e-97cb-d95eac9dc06a', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:25:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-0e98b890-a329-49a8-9a65-f2fee17ea891 req-e58ed15b-1539-489c-bb1a-03a096e1b1d4 tempest-AttachVolumeTestJSON-1457365710 None] attachment_update completed successfully. Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:33 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:33 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:34 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.602s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:25:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 8 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:25:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:25:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-edc2bf9c-2d6a-40a2-8a27-fc38e182955d req-f6766c4d-8ca1-421a-a1ff-9959282e86f7 tempest-AttachVolumeTestJSON-1457365710 None] Terminate volume connection completed successfully. Jul 31 07:25:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-edc2bf9c-2d6a-40a2-8a27-fc38e182955d req-f6766c4d-8ca1-421a-a1ff-9959282e86f7 tempest-AttachVolumeTestJSON-1457365710 None] Deleting attachment 67450725-a307-43a6-9879-1b7e613c394d. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:25:38 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-5c956b1f-84e8-48e9-ac97-ad879d97c65c req-0ee343d3-be0a-4e08-866a-d93c5c8ca5ae tempest-AttachVolumeTestJSON-1457365710 None] Terminate volume connection completed successfully. Jul 31 07:25:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-5c956b1f-84e8-48e9-ac97-ad879d97c65c req-0ee343d3-be0a-4e08-866a-d93c5c8ca5ae tempest-AttachVolumeTestJSON-1457365710 None] Deleting attachment 454dd8af-01fa-458e-97cb-d95eac9dc06a. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Flow 'volume_create_manager' (953490cb-d12b-4d96-815b-95f84cede430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989272e6-1004-47ab-8a3b-0dc9f859063a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989272e6-1004-47ab-8a3b-0dc9f859063a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795345608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407a6745-3f61-4116-a299-e91c6458b082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757547435ba843b7a2c2458e054328b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:45Z,use_quota=True,user_id='3bb969ce0d934a9bb43bdca5c019dbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c03d89b-5ae3-4d67-93c2-0bb55cab7d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c03d89b-5ae3-4d67-93c2-0bb55cab7d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a38f126-d095-4991-9ce8-aa8b1488125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a38f126-d095-4991-9ce8-aa8b1488125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407a6745-3f61-4116-a299-e91c6458b082', 'volume_name': 'volume-407a6745-3f61-4116-a299-e91c6458b082', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd661e1-a605-4fc2-a4fb-817b1dfb31c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd661e1-a605-4fc2-a4fb-817b1dfb31c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9a4d65-f6a4-4f47-9023-845b69ad665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Volume 407a6745-3f61-4116-a299-e91c6458b082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407a6745-3f61-4116-a299-e91c6458b082', 'volume_size': 1} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795345608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407a6745-3f61-4116-a299-e91c6458b082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757547435ba843b7a2c2458e054328b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:45Z,use_quota=True,user_id='3bb969ce0d934a9bb43bdca5c019dbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Creating volume 407a6745-3f61-4116-a299-e91c6458b082 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:25:45 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:45 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 1073741824 Jul 31 07:25:45 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:45 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 1073741824" returned: 0 in 0.673s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:46 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 Jul 31 07:25:46 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:46 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082" returned: 0 in 0.453s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:25:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9a4d65-f6a4-4f47-9023-845b69ad665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407a6745-3f61-4116-a299-e91c6458b082', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3624d8-a870-4be6-9379-d5b766fefe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Volume volume-407a6745-3f61-4116-a299-e91c6458b082 (407a6745-3f61-4116-a299-e91c6458b082): created successfully Jul 31 07:25:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3624d8-a870-4be6-9379-d5b766fefe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Flow 'volume_create_manager' (953490cb-d12b-4d96-815b-95f84cede430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-37021481-ac5d-437c-a323-a03938a981b0 tempest-ServersNegativeTestJSON-1440051213 None] Created volume successfully. Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "cinder-8b70eec9-a8a7-4f3b-9617-a3394f265fd5-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-8b70eec9-a8a7-4f3b-9617-a3394f265fd5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "cinder-quobyte-8b70eec9-a8a7-4f3b-9617-a3394f265fd5" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-quobyte-8b70eec9-a8a7-4f3b-9617-a3394f265fd5" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe44e31-bc4f-495b-aa77-038cc7c31cb2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:47 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 Jul 31 07:25:47 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:47 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5" returned: 0 in 0.623s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:47 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5 Jul 31 07:25:47 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:48 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b70eec9-a8a7-4f3b-9617-a3394f265fd5" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-quobyte-8b70eec9-a8a7-4f3b-9617-a3394f265fd5" released by "delete_volume" :: held 1.054s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Created reservations ['3cbbf46d-163b-49d8-bc1d-4fa87a60d39a', '8980f227-6368-4f12-8373-64a23c2a9d24', '53afe94a-1193-48d8-94eb-f58e45c74faa', '62aec4c6-992e-4d55-aab9-ee6a02e89931'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:48 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:48 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:48 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.338s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:48 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Deleted volume successfully. Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b854dcf2-1d13-4113-b5ce-b4bd14a8e26c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-8b70eec9-a8a7-4f3b-9617-a3394f265fd5-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "cinder-f75bdb88-3ce2-4e73-87b5-f084db1bbc92-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-f75bdb88-3ce2-4e73-87b5-f084db1bbc92-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "cinder-quobyte-f75bdb88-3ce2-4e73-87b5-f084db1bbc92" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-quobyte-f75bdb88-3ce2-4e73-87b5-f084db1bbc92" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6565d14-5890-401c-843b-82fede008abd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Flow 'volume_create_manager' (7aff11d8-a43e-4fda-b7b8-e006f802d7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a2d820-88d1-4a36-988b-7dafbeb42bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a2d820-88d1-4a36-988b-7dafbeb42bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-229715920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4143e928-fb96-4b46-a187-82e7f31339db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757547435ba843b7a2c2458e054328b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:50Z,use_quota=True,user_id='3bb969ce0d934a9bb43bdca5c019dbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb28fdb9-b789-4db4-b99e-72d06cf1063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb28fdb9-b789-4db4-b99e-72d06cf1063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed60e005-d569-4365-bb23-e0b264c325a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed60e005-d569-4365-bb23-e0b264c325a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4143e928-fb96-4b46-a187-82e7f31339db', 'volume_name': 'volume-4143e928-fb96-4b46-a187-82e7f31339db', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3e722e-bf95-4001-b6e7-1158114d00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3e722e-bf95-4001-b6e7-1158114d00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5efd2ed-88fe-4592-972c-2127adf4a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:49 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Volume 4143e928-fb96-4b46-a187-82e7f31339db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4143e928-fb96-4b46-a187-82e7f31339db', 'volume_size': 1} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-229715920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4143e928-fb96-4b46-a187-82e7f31339db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757547435ba843b7a2c2458e054328b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:25:50Z,use_quota=True,user_id='3bb969ce0d934a9bb43bdca5c019dbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Creating volume 4143e928-fb96-4b46-a187-82e7f31339db {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:25:49 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:25:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:49 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 Jul 31 07:25:49 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:49 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db 1073741824 Jul 31 07:25:49 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:50 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92" returned: 0 in 0.467s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:50 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92 Jul 31 07:25:50 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:50 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db 1073741824" returned: 0 in 0.575s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:50 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db Jul 31 07:25:50 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:50 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f75bdb88-3ce2-4e73-87b5-f084db1bbc92" returned: 0 in 0.384s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-quobyte-f75bdb88-3ce2-4e73-87b5-f084db1bbc92" released by "delete_volume" :: held 0.907s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Created reservations ['d82613f1-f170-4712-a94a-5a69b1d2aa70', '559f6cde-8746-4b78-96a1-5fa2ea3034e6', 'f5e05996-9698-4fe9-8508-4ba45b5ba048', 'c44da902-3309-4205-af3b-947c82755e44'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:50 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:50 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:50 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db" returned: 0 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5efd2ed-88fe-4592-972c-2127adf4a477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4143e928-fb96-4b46-a187-82e7f31339db', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b14d20-51a1-4a7e-bc58-a6ffd890b8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:25:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Volume volume-4143e928-fb96-4b46-a187-82e7f31339db (4143e928-fb96-4b46-a187-82e7f31339db): created successfully Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b14d20-51a1-4a7e-bc58-a6ffd890b8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Flow 'volume_create_manager' (7aff11d8-a43e-4fda-b7b8-e006f802d7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:25:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c46fc585-c5aa-49cc-826d-f156585ad9cd tempest-ServersNegativeTestJSON-1440051213 None] Created volume successfully. Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "cinder-33cbcf00-cd4c-4927-895b-3bf0d5926c3c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-33cbcf00-cd4c-4927-895b-3bf0d5926c3c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "cinder-quobyte-33cbcf00-cd4c-4927-895b-3bf0d5926c3c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-quobyte-33cbcf00-cd4c-4927-895b-3bf0d5926c3c" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1809c0-f5e5-4e0b-8ebe-e9e15c65abb5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:50 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.389s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:50 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Deleted volume successfully. Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e4ed58be-4585-4c9f-a5b4-f1856dd9145c tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-f75bdb88-3ce2-4e73-87b5-f084db1bbc92-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:51 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c Jul 31 07:25:51 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:51 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c" returned: 0 in 0.404s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:51 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c Jul 31 07:25:51 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:51 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-33cbcf00-cd4c-4927-895b-3bf0d5926c3c" returned: 0 in 0.370s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-quobyte-33cbcf00-cd4c-4927-895b-3bf0d5926c3c" released by "delete_volume" :: held 0.826s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Created reservations ['5478652c-16a5-4ce0-a746-c586ae7cb934', '5d7907e0-7ebd-4e8e-948b-6d02c79f977a', 'e318d8cc-321f-4991-87da-baff52ea1881', '636afeb2-4baf-44c8-bdfd-9e256a20362f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:51 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:51 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:52 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "cinder-4143e928-fb96-4b46-a187-82e7f31339db-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.339s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:52 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Deleted volume successfully. Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-4143e928-fb96-4b46-a187-82e7f31339db-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9bd4094e-c5df-41ec-9370-f7b2260082bf tempest-AttachVolumeTestJSON-1457365710 None] Lock "cinder-33cbcf00-cd4c-4927-895b-3bf0d5926c3c-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "cinder-quobyte-4143e928-fb96-4b46-a187-82e7f31339db" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-quobyte-4143e928-fb96-4b46-a187-82e7f31339db" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c652bcd-4953-49c9-90c4-ec4b303d3da1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:52 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db Jul 31 07:25:52 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:52 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db" returned: 0 in 0.400s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:52 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db Jul 31 07:25:52 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:53 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4143e928-fb96-4b46-a187-82e7f31339db" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-quobyte-4143e928-fb96-4b46-a187-82e7f31339db" released by "delete_volume" :: held 0.790s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Created reservations ['457e7db8-fc5f-41f4-b4aa-4b5ffcce26c3', '0e016d32-ef24-4407-bcc6-91d816299af9', '4fc3a2f1-9596-4be7-8820-8eb6741f68b6', '53548cdd-6f74-4c27-ad71-fa0f697cfbda'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:53 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:53 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "cinder-407a6745-3f61-4116-a299-e91c6458b082-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-407a6745-3f61-4116-a299-e91c6458b082-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "cinder-quobyte-407a6745-3f61-4116-a299-e91c6458b082" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-quobyte-407a6745-3f61-4116-a299-e91c6458b082" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3209d6fa-8e22-427f-8dcf-eddd41d1e48d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:53 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.356s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:53 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 Jul 31 07:25:53 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Deleted volume successfully. Jul 31 07:25:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5560dea5-bc10-46aa-8ad4-e69b785be5ef tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-4143e928-fb96-4b46-a187-82e7f31339db-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:54 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082" returned: 0 in 0.524s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:54 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082 Jul 31 07:25:54 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:54 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-407a6745-3f61-4116-a299-e91c6458b082" returned: 0 in 0.285s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-quobyte-407a6745-3f61-4116-a299-e91c6458b082" released by "delete_volume" :: held 0.858s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=82,cinder:SELECT=60,cinder:DELETE=4,cinder:INSERT=14 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=74,cinder:INSERT=16,cinder:UPDATE=61,cinder:DELETE=8 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Created reservations ['8b878cce-e720-462f-8c6b-83aeabb6dcef', '0921d723-b2d1-409d-8ba7-ff3bf12d9110', 'c222e409-c98b-459a-b3a4-90567a4194ce', '25ff7327-827e-4bf9-ba03-c0b42e62cd4d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:25:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:25:54 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:25:54 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:25:54 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 31 07:25:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.323s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:25:55 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:25:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Deleted volume successfully. Jul 31 07:25:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c10d872-bc76-4e83-adb9-b5206cc954e2 tempest-ServersNegativeTestJSON-1440051213 None] Lock "cinder-407a6745-3f61-4116-a299-e91c6458b082-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:04 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:26:05 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:INSERT=3,cinder:UPDATE=5,cinder:SELECT=3,cinder:DELETE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Flow 'volume_create_manager' (1355c9ac-038d-4387-9531-a5c785961ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d80c79d-a7c2-4a18-909f-5bb1140072a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d80c79d-a7c2-4a18-909f-5bb1140072a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-810762845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb9e3f0-811c-4e2d-ba52-3670c7d6b406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d77d78a1c63433491be0ff26b2894d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:17Z,use_quota=True,user_id='88cab6a2771c4d78b3f6024ca0251a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548a05a0-d627-4548-a370-521e5d2bcbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548a05a0-d627-4548-a370-521e5d2bcbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d611fb-9d3c-419a-9f6a-61e72891eec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d611fb-9d3c-419a-9f6a-61e72891eec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb9e3f0-811c-4e2d-ba52-3670c7d6b406', 'volume_name': 'volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5697d7d-d233-4ce3-bee9-f0bb86fa6ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5697d7d-d233-4ce3-bee9-f0bb86fa6ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7440f4e3-aae9-4580-8559-cb59c419eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Volume bdb9e3f0-811c-4e2d-ba52-3670c7d6b406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406', 'volume_size': 1} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-810762845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb9e3f0-811c-4e2d-ba52-3670c7d6b406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d77d78a1c63433491be0ff26b2894d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:17Z,use_quota=True,user_id='88cab6a2771c4d78b3f6024ca0251a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Creating volume bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:16 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:17 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 1073741824 Jul 31 07:26:17 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:17 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 1073741824" returned: 0 in 0.628s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:17 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 Jul 31 07:26:17 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:18 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406" returned: 0 in 0.443s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7440f4e3-aae9-4580-8559-cb59c419eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ee4697-d389-4f7c-8ca9-69f808d25a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Volume volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 (bdb9e3f0-811c-4e2d-ba52-3670c7d6b406): created successfully Jul 31 07:26:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ee4697-d389-4f7c-8ca9-69f808d25a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Flow 'volume_create_manager' (1355c9ac-038d-4387-9531-a5c785961ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6cdf2eac-4023-4d5a-8a1e-9844dd5e6bc2 tempest-VolumesTestJSON-905511599 None] Created volume successfully. Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Flow 'volume_create_manager' (8f515f32-2f3b-43e4-99b9-be3c66709812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d426fde5-0ea7-4ef6-8398-f1a58cd6d951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d426fde5-0ea7-4ef6-8398-f1a58cd6d951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-14854289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d77d78a1c63433491be0ff26b2894d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:20Z,use_quota=True,user_id='88cab6a2771c4d78b3f6024ca0251a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287e1166-d45f-4549-b9c2-15ad2a1995d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287e1166-d45f-4549-b9c2-15ad2a1995d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163e58f1-6e9a-4517-9924-eaf72381d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163e58f1-6e9a-4517-9924-eaf72381d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4', 'volume_name': 'volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe383b-5167-4aee-ad37-a0f744e5dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe383b-5167-4aee-ad37-a0f744e5dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4605dd5d-2124-4a8a-872f-74754c553484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:20 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Volume 1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4', 'volume_size': 1} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-14854289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d77d78a1c63433491be0ff26b2894d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:20Z,use_quota=True,user_id='88cab6a2771c4d78b3f6024ca0251a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Creating volume 1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:20 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:20 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 1073741824 Jul 31 07:26:20 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:21 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 1073741824" returned: 0 in 1.207s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:21 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 Jul 31 07:26:21 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:22 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4" returned: 0 in 0.354s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4605dd5d-2124-4a8a-872f-74754c553484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0fe009-f648-4e8d-9ac5-cb949a4bf251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:22 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Volume volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 (1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4): created successfully Jul 31 07:26:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0fe009-f648-4e8d-9ac5-cb949a4bf251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Flow 'volume_create_manager' (8f515f32-2f3b-43e4-99b9-be3c66709812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-10d5b764-383a-4f8d-944a-f3f48cc23dbe tempest-VolumesTestJSON-905511599 None] Created volume successfully. Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Flow 'volume_create_manager' (420ca5ce-e402-435b-a852-8bc3095bedd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506d558c-24f7-4274-a322-d6d94ae635a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506d558c-24f7-4274-a322-d6d94ae635a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1192818487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945e5cdb-f2ed-44f1-9961-cdf0bac6af01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d77d78a1c63433491be0ff26b2894d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:24Z,use_quota=True,user_id='88cab6a2771c4d78b3f6024ca0251a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d4e266-2744-4855-94ba-d1a55574ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d4e266-2744-4855-94ba-d1a55574ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec189e89-0b61-4ff4-b64d-4c930b254d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec189e89-0b61-4ff4-b64d-4c930b254d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945e5cdb-f2ed-44f1-9961-cdf0bac6af01', 'volume_name': 'volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c121a9b1-e401-49fc-a28a-cbf4616122d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c121a9b1-e401-49fc-a28a-cbf4616122d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5b32e1-2bd3-4d75-9524-328aae64c362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:24 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Volume 945e5cdb-f2ed-44f1-9961-cdf0bac6af01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01', 'volume_size': 1} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1192818487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945e5cdb-f2ed-44f1-9961-cdf0bac6af01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d77d78a1c63433491be0ff26b2894d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:24Z,use_quota=True,user_id='88cab6a2771c4d78b3f6024ca0251a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Creating volume 945e5cdb-f2ed-44f1-9961-cdf0bac6af01 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:24 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:24 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 1073741824 Jul 31 07:26:24 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:24 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 1073741824" returned: 0 in 0.474s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:24 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 Jul 31 07:26:24 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:24 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01" returned: 0 in 0.269s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5b32e1-2bd3-4d75-9524-328aae64c362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49da5e7a-5e70-4d93-96a5-2a99d021b4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:24 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Volume volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 (945e5cdb-f2ed-44f1-9961-cdf0bac6af01): created successfully Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49da5e7a-5e70-4d93-96a5-2a99d021b4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Flow 'volume_create_manager' (420ca5ce-e402-435b-a852-8bc3095bedd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0cd926c6-e562-4a20-92ef-6c2cd200bc39 tempest-VolumesTestJSON-905511599 None] Created volume successfully. Jul 31 07:26:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Acquiring lock "cinder-945e5cdb-f2ed-44f1-9961-cdf0bac6af01-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-945e5cdb-f2ed-44f1-9961-cdf0bac6af01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Acquiring lock "cinder-quobyte-945e5cdb-f2ed-44f1-9961-cdf0bac6af01" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-quobyte-945e5cdb-f2ed-44f1-9961-cdf0bac6af01" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:27 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f8cae-8275-4919-b0f4-c1f66d7ea2da]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:26:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:27 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 Jul 31 07:26:27 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:28 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01" returned: 0 in 0.442s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:28 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01 Jul 31 07:26:28 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:28 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-945e5cdb-f2ed-44f1-9961-cdf0bac6af01" returned: 0 in 0.283s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-quobyte-945e5cdb-f2ed-44f1-9961-cdf0bac6af01" released by "delete_volume" :: held 0.769s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Created reservations ['f3a26dde-cb90-48fc-beaa-f6d04310e4f0', 'a60a9e48-52bf-4f7d-9cff-f8ea548cdd79', '313153af-d063-4426-8039-e6b078e05438', '35653b55-7032-4967-8382-a1d963e90694'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:28 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:26:28 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Acquiring lock "cinder-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Lock "cinder-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Acquiring lock "cinder-quobyte-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Lock "cinder-quobyte-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4" acquired by "delete_volume" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:28 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.469s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:26:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Deleted volume successfully. Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[06132086-f469-4b45-b486-0458d5bdced9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:26:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0f9cc7b4-4130-417a-bd62-4a0d955e94a9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-945e5cdb-f2ed-44f1-9961-cdf0bac6af01-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:29 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 Jul 31 07:26:29 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:29 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4" returned: 0 in 0.466s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:29 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4 Jul 31 07:26:29 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:29 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4" returned: 0 in 0.289s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Lock "cinder-quobyte-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4" released by "delete_volume" :: held 0.836s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Created reservations ['b878baee-d3d5-45e0-b353-d9cca0c46c2f', '827153a9-e33a-4388-84a8-bc364013f362', '9055e52e-5d08-42b6-850d-9e3d02974f11', 'a0925d7d-c57e-4ad5-9a2e-faabb9e7bf3d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:30 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:26:30 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Acquiring lock "cinder-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Acquiring lock "cinder-quobyte-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-quobyte-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29986df-b53a-4366-bd7a-c6b72da14a79]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:30 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.415s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:26:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Deleted volume successfully. Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1e104fc3-43d6-4847-9e3f-43c2f5f5e416 tempest-VolumesTestJSON-905511599 None] Lock "cinder-1e9fc2fa-e70c-4460-8a4c-44ca9c1385d4-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:30 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 Jul 31 07:26:30 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:30 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406" returned: 0 in 0.439s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:30 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406 Jul 31 07:26:30 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:31 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406" returned: 0 in 0.314s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-quobyte-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406" released by "delete_volume" :: held 0.810s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Created reservations ['679bc67b-0536-47ac-8fa8-bd4b3d375918', '03b7d75c-eced-4106-aa2b-923d2f89ec7b', '71b260a5-016a-4c90-9198-5baba23f4422', 'f5685ce5-50a3-4fe3-bf2f-d63c3b3e8600'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:31 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:26:31 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:31 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:26:31 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Deleted volume successfully. Jul 31 07:26:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ff3ffc62-a6e6-4eb2-8968-29fe2e9e53e9 tempest-VolumesTestJSON-905511599 None] Lock "cinder-bdb9e3f0-811c-4e2d-ba52-3670c7d6b406-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Flow 'volume_create_manager' (abf76316-b68d-4526-94a3-a3cbc85c7e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45116578-d095-4c8f-8706-4abc401c3a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45116578-d095-4c8f-8706-4abc401c3a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-530365101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67246a1b-b4a9-4664-86f8-8f1a0f1db4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4c295fdac4749ab628c9aac64e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:33Z,use_quota=True,user_id='7d190d7ba3324db593887cb068d445fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5407c-7251-4416-b2b5-8a536905550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5407c-7251-4416-b2b5-8a536905550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd3d09d-f3c0-4603-b1cc-cf5c0a23be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd3d09d-f3c0-4603-b1cc-cf5c0a23be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67246a1b-b4a9-4664-86f8-8f1a0f1db4eb', 'volume_name': 'volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e6567f-2f45-4158-b9ef-52198ae3b8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e6567f-2f45-4158-b9ef-52198ae3b8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51accb2-10f8-489b-a2e7-b0a765fc2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:33 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Volume 67246a1b-b4a9-4664-86f8-8f1a0f1db4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb', 'volume_size': 1} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-530365101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67246a1b-b4a9-4664-86f8-8f1a0f1db4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4c295fdac4749ab628c9aac64e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:33Z,use_quota=True,user_id='7d190d7ba3324db593887cb068d445fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Creating volume 67246a1b-b4a9-4664-86f8-8f1a0f1db4eb {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:33 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:33 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb 1073741824 Jul 31 07:26:33 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:33 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:26:33 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:33 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb 1073741824" returned: 0 in 0.483s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:33 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb Jul 31 07:26:33 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:33 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.303s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 8 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:26:34 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb" returned: 0 in 0.308s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51accb2-10f8-489b-a2e7-b0a765fc2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21addfa-1000-4dbf-be30-94f3b7a22779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:34 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Volume volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb (67246a1b-b4a9-4664-86f8-8f1a0f1db4eb): created successfully Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21addfa-1000-4dbf-be30-94f3b7a22779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Flow 'volume_create_manager' (abf76316-b68d-4526-94a3-a3cbc85c7e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-510cb99b-0330-4497-94d2-31a7ec1a70e6 tempest-AttachVolumeNegativeTest-1195133799 None] Created volume successfully. Jul 31 07:26:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-ce27e924-3df8-41f3-8236-1ee76181e674 req-6b00b472-5787-4d8d-a58c-77a4c60a2761 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-ce27e924-3df8-41f3-8236-1ee76181e674 req-6b00b472-5787-4d8d-a58c-77a4c60a2761 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-ce27e924-3df8-41f3-8236-1ee76181e674 req-6b00b472-5787-4d8d-a58c-77a4c60a2761 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-ce27e924-3df8-41f3-8236-1ee76181e674 req-6b00b472-5787-4d8d-a58c-77a4c60a2761 tempest-AttachVolumeNegativeTest-1195133799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d6c3e7e-99d0-43f5-a282-647453bd0606', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:26:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-ce27e924-3df8-41f3-8236-1ee76181e674 req-6b00b472-5787-4d8d-a58c-77a4c60a2761 tempest-AttachVolumeNegativeTest-1195133799 None] attachment_update completed successfully. Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Flow 'volume_create_manager' (d6ef5e85-436e-426f-86ff-1288533494df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78cb81c3-9d3e-49e1-ae69-aef60ed82cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78cb81c3-9d3e-49e1-ae69-aef60ed82cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1725626110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a97069-5809-409d-ae09-3643dcfb7589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848e746d709417d94b3b30cac440953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:43Z,use_quota=True,user_id='573a9df0bd994159b7a9ea83a6258e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0d8901-dad5-4add-923a-9c60b092c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0d8901-dad5-4add-923a-9c60b092c939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db18ba9-d104-4bfc-89fc-4a551d97fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db18ba9-d104-4bfc-89fc-4a551d97fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a97069-5809-409d-ae09-3643dcfb7589', 'volume_name': 'volume-72a97069-5809-409d-ae09-3643dcfb7589', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50367e4b-a02f-4a0a-bf7e-f47956953c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50367e4b-a02f-4a0a-bf7e-f47956953c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803546b0-6010-4a2d-8d97-998cde8c418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:43 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Volume 72a97069-5809-409d-ae09-3643dcfb7589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a97069-5809-409d-ae09-3643dcfb7589', 'volume_size': 1} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1725626110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a97069-5809-409d-ae09-3643dcfb7589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0848e746d709417d94b3b30cac440953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:43Z,use_quota=True,user_id='573a9df0bd994159b7a9ea83a6258e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Creating volume 72a97069-5809-409d-ae09-3643dcfb7589 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:43 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:43 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 1073741824 Jul 31 07:26:43 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:43 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 1073741824" returned: 0 in 0.584s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:44 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 Jul 31 07:26:44 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:44 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589" returned: 0 in 0.382s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803546b0-6010-4a2d-8d97-998cde8c418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a97069-5809-409d-ae09-3643dcfb7589', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99266c1-832c-4886-9535-c4f94cd86deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Volume volume-72a97069-5809-409d-ae09-3643dcfb7589 (72a97069-5809-409d-ae09-3643dcfb7589): created successfully Jul 31 07:26:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99266c1-832c-4886-9535-c4f94cd86deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Flow 'volume_create_manager' (d6ef5e85-436e-426f-86ff-1288533494df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f512634e-75b1-4ab7-b053-40d905b1b498 tempest-AttachVolumeShelveTestJSON-1983586888 None] Created volume successfully. Jul 31 07:26:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Flow 'volume_create_manager' (7266199c-8c2c-4c18-ab9a-d5145a3e6805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434f2b8e-d84b-47d6-8d68-97c04465354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434f2b8e-d84b-47d6-8d68-97c04465354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1082137066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaccb44a-996d-4efa-a014-aeaca5896d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546ba4e896434516b571aa6740077891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:46Z,use_quota=True,user_id='a9a2bcf9e59341399a68702aa9e07b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8336301d-7ce3-4a95-af09-e351e3a5bd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8336301d-7ce3-4a95-af09-e351e3a5bd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4004be52-6a59-4d44-84c7-dfa68850167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4004be52-6a59-4d44-84c7-dfa68850167f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaccb44a-996d-4efa-a014-aeaca5896d6a', 'volume_name': 'volume-eaccb44a-996d-4efa-a014-aeaca5896d6a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5669b9dd-215c-4e82-aadb-aa5aa87cda3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5669b9dd-215c-4e82-aadb-aa5aa87cda3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323b64f1-a23c-4dab-90da-13064e4c3794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Volume eaccb44a-996d-4efa-a014-aeaca5896d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaccb44a-996d-4efa-a014-aeaca5896d6a', 'volume_size': 1} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1082137066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaccb44a-996d-4efa-a014-aeaca5896d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546ba4e896434516b571aa6740077891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:46Z,use_quota=True,user_id='a9a2bcf9e59341399a68702aa9e07b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Creating volume eaccb44a-996d-4efa-a014-aeaca5896d6a {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:46 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:46 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a 1073741824 Jul 31 07:26:46 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:46 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a 1073741824" returned: 0 in 0.673s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:46 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a Jul 31 07:26:46 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:47 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a" returned: 0 in 0.396s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323b64f1-a23c-4dab-90da-13064e4c3794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaccb44a-996d-4efa-a014-aeaca5896d6a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9761417-77c5-4b56-9516-8bf60b12141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:47 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Volume volume-eaccb44a-996d-4efa-a014-aeaca5896d6a (eaccb44a-996d-4efa-a014-aeaca5896d6a): created successfully Jul 31 07:26:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9761417-77c5-4b56-9516-8bf60b12141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Flow 'volume_create_manager' (7266199c-8c2c-4c18-ab9a-d5145a3e6805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cb253f18-440e-4696-8f82-4e4a7066ba1e tempest-VolumeQuotasAdminTestJSON-461610288 None] Created volume successfully. Jul 31 07:26:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Acquiring lock "cinder-eaccb44a-996d-4efa-a014-aeaca5896d6a-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "cinder-eaccb44a-996d-4efa-a014-aeaca5896d6a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Acquiring lock "cinder-quobyte-eaccb44a-996d-4efa-a014-aeaca5896d6a" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "cinder-quobyte-eaccb44a-996d-4efa-a014-aeaca5896d6a" acquired by "delete_volume" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:48 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f6148-0ad9-41f4-9f6b-d4e9757b4c1c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:26:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:48 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a Jul 31 07:26:48 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:49 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a" returned: 0 in 0.502s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:49 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a Jul 31 07:26:49 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:49 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eaccb44a-996d-4efa-a014-aeaca5896d6a" returned: 0 in 0.309s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "cinder-quobyte-eaccb44a-996d-4efa-a014-aeaca5896d6a" released by "delete_volume" :: held 0.908s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Created reservations ['41e0e494-b90b-4ffc-831b-d0f7e6733c52', '50c6f64c-df5c-49a0-a1a0-7c188194f8be', 'bacd423b-20ac-46fb-9720-c5af3ce21f37', '092298ef-f315-459f-aaca-77801dc93164'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:49 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:26:49 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:50 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.577s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:26:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Deleted volume successfully. Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18232dae-d256-48e4-9dc2-e833f326b3e9 tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "cinder-eaccb44a-996d-4efa-a014-aeaca5896d6a-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Flow 'volume_create_manager' (c3a9a1a4-d807-44e9-a983-cc043b38057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ebb868-08ab-493f-892a-8ebacef57fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ebb868-08ab-493f-892a-8ebacef57fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-236240165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30e1b58-8d7f-41c8-ad8b-2cea9f93069c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546ba4e896434516b571aa6740077891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:50Z,use_quota=True,user_id='a9a2bcf9e59341399a68702aa9e07b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d241e226-56d2-4265-a420-d09a5b80bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d241e226-56d2-4265-a420-d09a5b80bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf89257-06df-419d-ba18-312453c7002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf89257-06df-419d-ba18-312453c7002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30e1b58-8d7f-41c8-ad8b-2cea9f93069c', 'volume_name': 'volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601aefc8-e812-44ea-9531-d145d6333fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601aefc8-e812-44ea-9531-d145d6333fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e648692-4bc7-4b95-bf34-093d57ad86b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Volume a30e1b58-8d7f-41c8-ad8b-2cea9f93069c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c', 'volume_size': 1} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-236240165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30e1b58-8d7f-41c8-ad8b-2cea9f93069c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546ba4e896434516b571aa6740077891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:50Z,use_quota=True,user_id='a9a2bcf9e59341399a68702aa9e07b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Creating volume a30e1b58-8d7f-41c8-ad8b-2cea9f93069c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:50 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:50 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c 1073741824 Jul 31 07:26:50 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:51 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c 1073741824" returned: 0 in 0.879s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:51 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c Jul 31 07:26:51 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:51 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c" returned: 0 in 0.424s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e648692-4bc7-4b95-bf34-093d57ad86b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f432f9-cd05-41fe-adba-7c361dc9063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:51 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Volume volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c (a30e1b58-8d7f-41c8-ad8b-2cea9f93069c): created successfully Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f432f9-cd05-41fe-adba-7c361dc9063e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Flow 'volume_create_manager' (c3a9a1a4-d807-44e9-a983-cc043b38057d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:52 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-46c5331b-cbbd-4d40-86a8-082671ba31cb tempest-VolumeQuotasAdminTestJSON-461610288 None] Created volume successfully. Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Flow 'volume_create_manager' (2339db0c-7270-4b69-a2cc-a81ca78e27b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e17668-e5c7-4298-bd6d-f03b71e38610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e17668-e5c7-4298-bd6d-f03b71e38610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1420123423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d723dd74-64bb-4e13-a1a9-dcbacfe4a788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e8d23b7e4797984ebfeca1dbcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:52Z,use_quota=True,user_id='22433531e5ca48e181704520590f0ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2150b4-d688-4ced-a891-621a88aec6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2150b4-d688-4ced-a891-621a88aec6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d314eb9-de65-4fbb-ac8f-3afec8440354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d314eb9-de65-4fbb-ac8f-3afec8440354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd723dd74-64bb-4e13-a1a9-dcbacfe4a788', 'volume_name': 'volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad03453f-1714-48a2-8483-d04209d28971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad03453f-1714-48a2-8483-d04209d28971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab35ce64-ad94-44be-b7b3-f4144a80ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:52 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Volume d723dd74-64bb-4e13-a1a9-dcbacfe4a788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788', 'volume_size': 1} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1420123423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d723dd74-64bb-4e13-a1a9-dcbacfe4a788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e8d23b7e4797984ebfeca1dbcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:26:52Z,use_quota=True,user_id='22433531e5ca48e181704520590f0ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Creating volume d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:26:52 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:52 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 1073741824 Jul 31 07:26:52 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:52 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 1073741824" returned: 0 in 0.619s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:52 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 Jul 31 07:26:52 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:53 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" returned: 0 in 0.580s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:26:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab35ce64-ad94-44be-b7b3-f4144a80ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fdeceb-0c04-4294-82c6-85fabfca7f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:26:53 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Volume volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 (d723dd74-64bb-4e13-a1a9-dcbacfe4a788): created successfully Jul 31 07:26:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fdeceb-0c04-4294-82c6-85fabfca7f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:26:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Flow 'volume_create_manager' (2339db0c-7270-4b69-a2cc-a81ca78e27b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:26:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4a16f884-47cd-4ade-a3c7-f2eb0efa77fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Created volume successfully. Jul 31 07:26:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2c026532-2089-43b0-b93f-328823de1bd6 tempest-VolumeQuotasAdminTestJSON-2088968647 None] Transfer volume completed successfully. Jul 31 07:26:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Creating offline snapshot dcff8ff5-82f2-47c1-983f-54d5f94caeb5 of volume d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:26:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[668aef54-b278-457b-9717-c188884af91c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:26:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:54 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 Jul 31 07:26:54 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Acquiring lock "cinder-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Lock "cinder-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Acquiring lock "cinder-quobyte-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:55 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" returned: 0 in 0.611s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Lock "cinder-quobyte-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c" acquired by "delete_volume" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:55 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 1G Jul 31 07:26:55 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc0153-39f6-4947-a5fc-12f7bc8d229c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:26:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:55 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c Jul 31 07:26:55 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:56 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 1G" returned: 0 in 0.732s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:56 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 Jul 31 07:26:56 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:56 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c" returned: 0 in 0.705s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:56 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c Jul 31 07:26:56 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:56 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c" returned: 0 in 0.442s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Lock "cinder-quobyte-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c" released by "delete_volume" :: held 1.227s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:56 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5" returned: 0 in 0.612s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:56 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 is being set with open permissions: ugo+rw Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Created reservations ['c3b2be8b-d511-4516-b755-9b0ffb45ab07', '0657e127-9821-46ed-8ff8-19c8194f52a7', '674d5619-ec93-495c-8fec-33216dabad1a', '67bc80ab-5333-47be-aca2-7a150a16f434'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:26:56 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 Jul 31 07:26:56 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:57 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:26:57 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:57 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5" returned: 0 in 0.549s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:57 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.info Jul 31 07:26:57 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:57 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.572s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:57 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:26:57 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Deleted volume successfully. Jul 31 07:26:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-54c78fa3-1c8d-4460-8fb9-c56c63da2ee1 tempest-VolumeQuotasAdminTestJSON-804428021 None] Lock "cinder-a30e1b58-8d7f-41c8-ad8b-2cea9f93069c-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:26:57 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.info" returned: 0 in 0.507s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:57 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.info is being set with open permissions: ugo+rw Jul 31 07:26:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:57 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.info Jul 31 07:26:57 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:26:58 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 31 07:26:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.info" returned: 0 in 0.377s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:26:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.503s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:26:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-dda682af-9bfd-4d61-8dcb-fc032bd8f627 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Create snapshot completed successfully Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "cinder-dcff8ff5-82f2-47c1-983f-54d5f94caeb5-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-dcff8ff5-82f2-47c1-983f-54d5f94caeb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "cinder-quobyte-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-quobyte-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "cinder-quobyte-dcff8ff5-82f2-47c1-983f-54d5f94caeb5" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-quobyte-dcff8ff5-82f2-47c1-983f-54d5f94caeb5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Deleting offline snapshot dcff8ff5-82f2-47c1-983f-54d5f94caeb5 of volume d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] snapshot_file for this snap is: volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b201e-f499-4ebe-89d1-225eef0c2ce8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:26:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:26:59 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 Jul 31 07:26:59 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-aac8516b-1b39-40a6-ae3a-b30a23db6c57 req-dd43ffa0-918c-4d70-aaec-04e6caebeb30 tempest-AttachVolumeShelveTestJSON-1983586888 None] No connector for attachment 9678dd41-ff7a-4428-92b2-171a2193ab67; skipping storage backend terminate_connection call. {{(pid=88915) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-aac8516b-1b39-40a6-ae3a-b30a23db6c57 req-dd43ffa0-918c-4d70-aaec-04e6caebeb30 tempest-AttachVolumeShelveTestJSON-1983586888 None] Deleting attachment 9678dd41-ff7a-4428-92b2-171a2193ab67. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:27:00 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5" returned: 0 in 0.641s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd244e91-dd89-4800-9fe9-e508ad568d97]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:00 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 Jul 31 07:27:00 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:00 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" returned: 0 in 0.562s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:00 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 Jul 31 07:27:00 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:01 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5" returned: 0 in 0.605s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:01 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5 Jul 31 07:27:01 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:01 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788.dcff8ff5-82f2-47c1-983f-54d5f94caeb5" returned: 0 in 0.411s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-quobyte-dcff8ff5-82f2-47c1-983f-54d5f94caeb5" released by "_delete_snapshot" :: held 2.395s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-quobyte-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" released by "delete_snapshot" :: held 2.433s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:02 devstack cinder-volume[88915]: WARNING cinder.quota [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:27:02 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Created reservations ['55a7034e-9317-4616-9159-d3465205c49a', '32c09cee-c8ff-4df7-9950-9c01a017e3d9', '18a1c2eb-62b5-4cc5-be60-df38b6205aca', '9ea5d15a-e7f4-479d-84fb-b9bded981711'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:27:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Delete snapshot completed successfully. Jul 31 07:27:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d83e925-8a82-44c2-bb97-3b45cd33b777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-dcff8ff5-82f2-47c1-983f-54d5f94caeb5-delete_snapshot" released by "delete_snapshot" :: held 2.671s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "cinder-d723dd74-64bb-4e13-a1a9-dcbacfe4a788-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-d723dd74-64bb-4e13-a1a9-dcbacfe4a788-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "cinder-quobyte-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-quobyte-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0314565d-d97e-4301-a3f3-634818900eda]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:03 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 Jul 31 07:27:03 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:03 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" returned: 0 in 0.476s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:03 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788 Jul 31 07:27:03 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:04 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" returned: 0 in 0.340s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-quobyte-d723dd74-64bb-4e13-a1a9-dcbacfe4a788" released by "delete_volume" :: held 0.921s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Created reservations ['2446b2b0-e064-4afd-9c9a-098e323ce5c0', '3302a647-6966-46c5-ac08-32d7d9ad9b49', 'eb9ababf-839e-4205-8cdc-d391ecd2bb26', 'a5bdce02-8ed0-4062-9ef7-f47fa5ee0a2e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:04 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:27:04 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:04 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.340s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:27:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Deleted volume successfully. Jul 31 07:27:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8f555d95-9e87-43f3-b5c4-e5734243fc23 tempest-VolumeSnapshotQuotasNegativeTestJSON-1180075253 None] Lock "cinder-d723dd74-64bb-4e13-a1a9-dcbacfe4a788-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Flow 'volume_create_manager' (0225fa5d-ef40-4e33-adb5-3c419e649918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addde08e-db2b-462a-962a-e72b47d0a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addde08e-db2b-462a-962a-e72b47d0a359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-984209416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf466529-14e2-4b1a-8309-ac97df427727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c184f22c724143ec88293a84b2a09157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:27:08Z,use_quota=True,user_id='de3ed4534c7e48c1855a9e086b885e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c528e9-6631-4b47-b737-f21373af51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c528e9-6631-4b47-b737-f21373af51df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b93cf8-f65b-45e5-847c-2492b998085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b93cf8-f65b-45e5-847c-2492b998085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf466529-14e2-4b1a-8309-ac97df427727', 'volume_name': 'volume-cf466529-14e2-4b1a-8309-ac97df427727', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27b59ee-3231-4e9b-9637-9883136e545e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27b59ee-3231-4e9b-9637-9883136e545e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c324f4c5-94d1-48ca-864f-296b1af876da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:07 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Volume cf466529-14e2-4b1a-8309-ac97df427727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf466529-14e2-4b1a-8309-ac97df427727', 'volume_size': 1} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-984209416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf466529-14e2-4b1a-8309-ac97df427727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c184f22c724143ec88293a84b2a09157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:27:08Z,use_quota=True,user_id='de3ed4534c7e48c1855a9e086b885e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Creating volume cf466529-14e2-4b1a-8309-ac97df427727 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:27:07 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:27:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:07 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 1073741824 Jul 31 07:27:07 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:08 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 1073741824" returned: 0 in 0.536s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:08 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 Jul 31 07:27:08 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:08 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727" returned: 0 in 0.314s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c324f4c5-94d1-48ca-864f-296b1af876da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf466529-14e2-4b1a-8309-ac97df427727', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ba4ffe-c218-4c0f-8bf1-2e8b32bba6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:08 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Volume volume-cf466529-14e2-4b1a-8309-ac97df427727 (cf466529-14e2-4b1a-8309-ac97df427727): created successfully Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ba4ffe-c218-4c0f-8bf1-2e8b32bba6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Flow 'volume_create_manager' (0225fa5d-ef40-4e33-adb5-3c419e649918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:27:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c17a039c-38a9-40f8-a4de-8eb71666f689 tempest-VolumesServicesTestJSON-1829411529 None] Created volume successfully. Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Acquiring lock "cinder-cf466529-14e2-4b1a-8309-ac97df427727-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Lock "cinder-cf466529-14e2-4b1a-8309-ac97df427727-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Acquiring lock "cinder-quobyte-cf466529-14e2-4b1a-8309-ac97df427727" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Lock "cinder-quobyte-cf466529-14e2-4b1a-8309-ac97df427727" acquired by "delete_volume" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1459f8f2-35ef-4632-a10e-d6dd86b7be4c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:10 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 Jul 31 07:27:10 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:10 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727" returned: 0 in 0.489s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:10 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727 Jul 31 07:27:10 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:11 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-cf466529-14e2-4b1a-8309-ac97df427727" returned: 0 in 0.393s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Lock "cinder-quobyte-cf466529-14e2-4b1a-8309-ac97df427727" released by "delete_volume" :: held 0.943s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Created reservations ['e2a8d9d0-b7fa-4eaa-bdb5-e54c5b6e755d', 'cd6016ed-f5e9-428b-a6df-8681f47a0fd2', 'dfbbc379-e2b7-4c67-af02-904db2f6e535', '400d10dd-d679-4246-875b-549f712cf33a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:11 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:27:11 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:11 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.407s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:27:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Deleted volume successfully. Jul 31 07:27:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-46d2043d-2cfa-49cf-82a8-3436a8b7771d tempest-VolumesServicesTestJSON-1829411529 None] Lock "cinder-cf466529-14e2-4b1a-8309-ac97df427727-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:18 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=92,cinder:DELETE=9,cinder:SELECT=63,cinder:INSERT=22 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:27:18 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=78,cinder:UPDATE=92,cinder:INSERT=20,cinder:DELETE=8 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:27:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-95d82f08-ec9e-4fa9-b62f-7acbce243759 req-79cf70ba-7df4-4f04-b581-3e44981516f7 tempest-AttachVolumeNegativeTest-1195133799 None] Terminate volume connection completed successfully. Jul 31 07:27:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-95d82f08-ec9e-4fa9-b62f-7acbce243759 req-79cf70ba-7df4-4f04-b581-3e44981516f7 tempest-AttachVolumeNegativeTest-1195133799 None] Deleting attachment 0d6c3e7e-99d0-43f5-a282-647453bd0606. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:33 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:27:33 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:33 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 8 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:27:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:27:34 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=2 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Flow 'volume_create_manager' (a65fc755-76a8-4305-a375-fb0e33a1e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f7aea6-c794-49e9-8b1c-3f94e3660c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f7aea6-c794-49e9-8b1c-3f94e3660c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-941011282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b100ea5-2e6f-4535-9512-ff7bf4fe3947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb7c79c5f5047679636de4e41864e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:27:41Z,use_quota=True,user_id='487a476813cc459ba2ba716400a3c5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2337b054-5100-4f61-82f7-d6c46bb9b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2337b054-5100-4f61-82f7-d6c46bb9b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b031e6f-60e7-470e-b2e8-96bd2aa17483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b031e6f-60e7-470e-b2e8-96bd2aa17483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b100ea5-2e6f-4535-9512-ff7bf4fe3947', 'volume_name': 'volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e333b8ec-95c6-4cbf-834e-2490c3b90e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e333b8ec-95c6-4cbf-834e-2490c3b90e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662e9af8-daf6-4fee-8d36-de37f1eec1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:41 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Volume 5b100ea5-2e6f-4535-9512-ff7bf4fe3947: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 07:27:41 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Trying to clone 5b100ea5-2e6f-4535-9512-ff7bf4fe3947 from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:27:42 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:27:42 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Image download 20.69 MB at 20.69 MB/s Jul 31 07:27:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ee66c2-ef72-4df5-8b4d-3ecc4bdba5ab]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:42 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD Jul 31 07:27:42 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:42 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:42 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e is fetched for user 487a476813cc459ba2ba716400a3c5a8. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a69df7-fc87-4902-b772-5259d16d60bb]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:43 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD Jul 31 07:27:43 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:43 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-941011282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b100ea5-2e6f-4535-9512-ff7bf4fe3947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb7c79c5f5047679636de4e41864e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:27:41Z,use_quota=True,user_id='487a476813cc459ba2ba716400a3c5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Creating volume 5b100ea5-2e6f-4535-9512-ff7bf4fe3947 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:27:43 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:43 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 1073741824 Jul 31 07:27:43 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:43 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 1073741824" returned: 0 in 0.472s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:43 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 Jul 31 07:27:43 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:44 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947" returned: 0 in 0.282s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Attempting download of 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume 5b100ea5-2e6f-4535-9512-ff7bf4fe3947. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ab3e3-4f0a-42f9-a50a-72b5fe5f73f3]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_v051hgqo {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:44 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_v051hgqo Jul 31 07:27:44 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:44 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_v051hgqo" returned: 0 in 0.397s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_v051hgqo {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:44 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_v051hgqo Jul 31 07:27:44 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:45 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_v051hgqo" returned: 1 in 0.588s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_v051hgqo' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22d0343-295d-47c6-9c3d-2bdd6ff6f316]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:45 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD Jul 31 07:27:45 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Acquiring lock "cinder-72a97069-5809-409d-ae09-3643dcfb7589-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "cinder-72a97069-5809-409d-ae09-3643dcfb7589-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Acquiring lock "cinder-quobyte-72a97069-5809-409d-ae09-3643dcfb7589" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "cinder-quobyte-72a97069-5809-409d-ae09-3643dcfb7589" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a74672c-6af0-45b7-9aea-896388860650]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:45 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD" returned: 0 in 0.654s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:45 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 Jul 31 07:27:45 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:46 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] 0c598684-d1fc-49c0-b0cf-3a02a6f8533e was qcow2, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:27:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:46 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 Jul 31 07:27:46 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:46 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589" returned: 0 in 0.833s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:46 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589 Jul 31 07:27:46 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:47 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-72a97069-5809-409d-ae09-3643dcfb7589" returned: 0 in 0.671s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "cinder-quobyte-72a97069-5809-409d-ae09-3643dcfb7589" released by "delete_volume" :: held 1.576s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Created reservations ['316b0be1-2794-4b87-bd28-dedef4b01150', 'aed04ab0-92cd-44dc-a506-ba161a439197', '5b76bf5a-c5b8-4ced-8394-682703402cb6', 'a536d0fc-d92a-4b57-919c-70aec5c1d86b'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:47 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:27:47 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:48 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.577s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:48 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:27:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Deleted volume successfully. Jul 31 07:27:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c4b91459-663a-44e7-93d4-8136867cd3a1 tempest-AttachVolumeShelveTestJSON-1983586888 None] Lock "cinder-72a97069-5809-409d-ae09-3643dcfb7589-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:49 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947" returned: 0 in 3.192s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_h77gscuodevstack@QuobyteHD, size 112.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:27:49 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Converted 112.00 MB image at 35.08 MB/s Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:49 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 1G Jul 31 07:27:49 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:49 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 1G" returned: 0 in 0.685s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Downloaded image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume 5b100ea5-2e6f-4535-9512-ff7bf4fe3947 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e for user 487a476813cc459ba2ba716400a3c5a8 is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Marking volume 5b100ea5-2e6f-4535-9512-ff7bf4fe3947 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Copying metadata from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e to 5b100ea5-2e6f-4535-9512-ff7bf4fe3947. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:27:49 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Creating volume glance metadata for volume 5b100ea5-2e6f-4535-9512-ff7bf4fe3947 backed by image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:27:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662e9af8-daf6-4fee-8d36-de37f1eec1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e51ea06-5642-4311-af1a-ddd856597e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Volume volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 (5b100ea5-2e6f-4535-9512-ff7bf4fe3947): created successfully Jul 31 07:27:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e51ea06-5642-4311-af1a-ddd856597e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Flow 'volume_create_manager' (a65fc755-76a8-4305-a375-fb0e33a1e80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:27:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b194a777-61fb-439a-ba6b-1d20a74f95b4 tempest-VolumesImageMetadata-815773484 None] Created volume successfully. Jul 31 07:27:51 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:27:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (892b175b-1a21-450a-a28b-6a8c0579450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:27:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddea2263-60bc-4fa2-a454-00b9970e8908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddea2263-60bc-4fa2-a454-00b9970e8908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1438021487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753fb99c-da90-4366-b0c7-a738d2dda698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:27:52Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477a5ca1-fc3b-4028-b636-2cfece144db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477a5ca1-fc3b-4028-b636-2cfece144db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6b3db1-b507-4bdb-8d77-b5d1c134d4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6b3db1-b507-4bdb-8d77-b5d1c134d4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753fb99c-da90-4366-b0c7-a738d2dda698', 'volume_name': 'volume-753fb99c-da90-4366-b0c7-a738d2dda698', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ad9350-f24d-4b0e-ac58-22b1ffa927fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ad9350-f24d-4b0e-ac58-22b1ffa927fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95429ef4-a8ef-4e47-af0c-19d4ab603c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:52 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Volume 753fb99c-da90-4366-b0c7-a738d2dda698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753fb99c-da90-4366-b0c7-a738d2dda698', 'volume_size': 1} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1438021487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753fb99c-da90-4366-b0c7-a738d2dda698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:27:52Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Creating volume 753fb99c-da90-4366-b0c7-a738d2dda698 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:27:52 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:52 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 1073741824 Jul 31 07:27:52 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Acquiring lock "cinder-5b100ea5-2e6f-4535-9512-ff7bf4fe3947-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Lock "cinder-5b100ea5-2e6f-4535-9512-ff7bf4fe3947-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Acquiring lock "cinder-quobyte-5b100ea5-2e6f-4535-9512-ff7bf4fe3947" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Lock "cinder-quobyte-5b100ea5-2e6f-4535-9512-ff7bf4fe3947" acquired by "delete_volume" :: waited 0.052s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[629e3e45-6d1e-47d1-a819-3a8b50fbc65a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:52 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 Jul 31 07:27:52 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:53 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 1073741824" returned: 0 in 0.958s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:53 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 Jul 31 07:27:53 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:53 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947" returned: 0 in 0.922s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:53 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698" returned: 0 in 0.563s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:53 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947 Jul 31 07:27:53 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95429ef4-a8ef-4e47-af0c-19d4ab603c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753fb99c-da90-4366-b0c7-a738d2dda698', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6142763-f0e6-45a1-a467-0e56d7bdaf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:27:53 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Volume volume-753fb99c-da90-4366-b0c7-a738d2dda698 (753fb99c-da90-4366-b0c7-a738d2dda698): created successfully Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6142763-f0e6-45a1-a467-0e56d7bdaf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:27:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (892b175b-1a21-450a-a28b-6a8c0579450c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:27:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0dd5064c-2f0f-42de-bcd4-1a9d5aad3f16 tempest-VolumesActionsTest-373251439 None] Created volume successfully. Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f58c1a83-f0f9-4231-aff3-13640db19ada tempest-VolumesActionsTest-373251439 None] Acquiring lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698" by "attach_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:54 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5b100ea5-2e6f-4535-9512-ff7bf4fe3947" returned: 0 in 0.633s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f58c1a83-f0f9-4231-aff3-13640db19ada tempest-VolumesActionsTest-373251439 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698" acquired by "attach_volume" :: waited 0.051s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Lock "cinder-quobyte-5b100ea5-2e6f-4535-9512-ff7bf4fe3947" released by "delete_volume" :: held 1.683s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f58c1a83-f0f9-4231-aff3-13640db19ada tempest-VolumesActionsTest-373251439 None] Attaching volume 753fb99c-da90-4366-b0c7-a738d2dda698 to instance 79bd16ed-cba7-451d-a68c-3cea1252dbdf at mountpoint /dev/vdb on host None. Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Created reservations ['132d3720-3f7c-43ad-8470-8053cecbb3c8', '7af8da87-9f12-41a6-b1ea-6155fd535eae', '5ec2943b-1a65-4892-a7a7-d4fcac0ddd88', 'e2031c08-52eb-487d-9fbc-cd5b52b889ed'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:27:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f58c1a83-f0f9-4231-aff3-13640db19ada tempest-VolumesActionsTest-373251439 None] Attach volume completed successfully. Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f58c1a83-f0f9-4231-aff3-13640db19ada tempest-VolumesActionsTest-373251439 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698" released by "attach_volume" :: held 0.231s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:54 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:27:54 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:55 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.525s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:55 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:27:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Deleted volume successfully. Jul 31 07:27:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-159c7581-4ab1-4e04-bf29-315704a05fe1 tempest-VolumesImageMetadata-815773484 None] Lock "cinder-5b100ea5-2e6f-4535-9512-ff7bf4fe3947-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-94dda647-38de-46ef-93f9-a87babffa4d8 tempest-VolumesActionsTest-1754265096 None] Terminate volume connection completed successfully. Jul 31 07:27:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94dda647-38de-46ef-93f9-a87babffa4d8 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-detach_volume" by "detach_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94dda647-38de-46ef-93f9-a87babffa4d8 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-94dda647-38de-46ef-93f9-a87babffa4d8 tempest-VolumesActionsTest-1754265096 None] Detaching volume 753fb99c-da90-4366-b0c7-a738d2dda698 from instance 79bd16ed-cba7-451d-a68c-3cea1252dbdf. Jul 31 07:27:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-94dda647-38de-46ef-93f9-a87babffa4d8 tempest-VolumesActionsTest-1754265096 None] Detach volume completed successfully. Jul 31 07:27:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94dda647-38de-46ef-93f9-a87babffa4d8 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-detach_volume" released by "detach_volume" :: held 0.189s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-007d0e4e-3b6d-4891-9286-f782a6426c54 tempest-VolumesActionsTest-373251439 None] Acquiring lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-detach_volume" by "detach_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-007d0e4e-3b6d-4891-9286-f782a6426c54 tempest-VolumesActionsTest-373251439 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-007d0e4e-3b6d-4891-9286-f782a6426c54 tempest-VolumesActionsTest-373251439 None] Volume detach called, but volume not attached. Jul 31 07:27:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-007d0e4e-3b6d-4891-9286-f782a6426c54 tempest-VolumesActionsTest-373251439 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Acquiring lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Acquiring lock "cinder-quobyte-753fb99c-da90-4366-b0c7-a738d2dda698" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:27:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Lock "cinder-quobyte-753fb99c-da90-4366-b0c7-a738d2dda698" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:27:57 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fae51e6-cfa4-4e64-9333-4180966e63a5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:27:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:57 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 Jul 31 07:27:57 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:58 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698" returned: 0 in 0.615s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:58 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698 Jul 31 07:27:58 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:58 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-753fb99c-da90-4366-b0c7-a738d2dda698" returned: 0 in 0.624s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Lock "cinder-quobyte-753fb99c-da90-4366-b0c7-a738d2dda698" released by "delete_volume" :: held 1.326s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:27:58 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Created reservations ['96e536dd-777a-4123-8b47-1c332f5fec71', '148b9bbf-684f-4be4-880d-1aad79979f7c', '491c109d-b2a0-4337-a01f-a42fd9a630de', '7d237be2-4c06-4b61-97d8-e205d7e45284'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:27:59 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:27:59 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:27:59 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.323s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:27:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Deleted volume successfully. Jul 31 07:27:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9f968c90-1479-4e5d-b449-17407d6f3d1d tempest-VolumesActionsTest-373251439 None] Lock "cinder-753fb99c-da90-4366-b0c7-a738d2dda698-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Flow 'volume_create_manager' (25c3e666-a9ff-42d5-8a60-514ec2ef03f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c95289e-1d9b-4078-a2c4-6b98e254a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c95289e-1d9b-4078-a2c4-6b98e254a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1554934643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05dda606-4173-426f-9841-e7dbe4c9cba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4963563a93be43e6adca25fef7853213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:03Z,use_quota=True,user_id='943e625fa7fe4404b77feb904c3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2006c077-3137-4f25-9752-6c098e0f0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2006c077-3137-4f25-9752-6c098e0f0e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1210973a-d904-4e37-9979-e071f7e46e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1210973a-d904-4e37-9979-e071f7e46e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05dda606-4173-426f-9841-e7dbe4c9cba8', 'volume_name': 'volume-05dda606-4173-426f-9841-e7dbe4c9cba8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bec1887-ed26-4cce-bae0-10e009a43850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bec1887-ed26-4cce-bae0-10e009a43850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29cd4cb-ac04-448c-a81d-ebc328e388d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:03 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Volume 05dda606-4173-426f-9841-e7dbe4c9cba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05dda606-4173-426f-9841-e7dbe4c9cba8', 'volume_size': 1} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1554934643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05dda606-4173-426f-9841-e7dbe4c9cba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4963563a93be43e6adca25fef7853213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:03Z,use_quota=True,user_id='943e625fa7fe4404b77feb904c3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Creating volume 05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:03 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:03 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 1073741824 Jul 31 07:28:03 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:03 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 1073741824" returned: 0 in 0.476s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:03 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 Jul 31 07:28:03 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:03 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29cd4cb-ac04-448c-a81d-ebc328e388d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05dda606-4173-426f-9841-e7dbe4c9cba8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e6961f-8eee-4504-8c3e-48ba3c53fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:04 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Volume volume-05dda606-4173-426f-9841-e7dbe4c9cba8 (05dda606-4173-426f-9841-e7dbe4c9cba8): created successfully Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e6961f-8eee-4504-8c3e-48ba3c53fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Flow 'volume_create_manager' (25c3e666-a9ff-42d5-8a60-514ec2ef03f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-cdd81a91-03fb-410f-b69c-ad0fac85b7b5 req-3f60b689-129a-42ac-b9f5-b7bce13b87ed tempest-VolumesSnapshotsTestJSON-601216672 None] Created volume successfully. Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Flow 'volume_create_manager' (e6056329-8e49-4244-b846-59151a976a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ba7347-17ac-4c6e-ae6f-5250e0dffa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ba7347-17ac-4c6e-ae6f-5250e0dffa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-718149655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222c9ec1a20c4318a1c7d5dca1e99801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:04Z,use_quota=True,user_id='5893e04738f54ff5814c9a816a64dcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d462d276-8b07-4952-b162-ce5eb67d3158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d462d276-8b07-4952-b162-ce5eb67d3158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388c9bd4-6aa5-40ef-913b-847bd5619e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388c9bd4-6aa5-40ef-913b-847bd5619e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7', 'volume_name': 'volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584741ab-e036-4a11-9078-b42d6507f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584741ab-e036-4a11-9078-b42d6507f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a0264d-de81-4bca-aa2b-c6de85a627f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:04 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Volume 31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7', 'volume_size': 1} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-718149655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222c9ec1a20c4318a1c7d5dca1e99801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:04Z,use_quota=True,user_id='5893e04738f54ff5814c9a816a64dcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Creating volume 31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:04 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:04 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 1073741824 Jul 31 07:28:04 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:05 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 1073741824" returned: 0 in 0.651s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:05 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 Jul 31 07:28:05 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (734faf2b-a982-4def-a537-02b17ff6f760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a12f3e-dcb4-40ea-aeda-7e9e74adaf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a12f3e-dcb4-40ea-aeda-7e9e74adaf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354360968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8abc957-d126-453d-84eb-22d3e5a892be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:05Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee36edb9-51e2-4d41-8fec-94b67bb2fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee36edb9-51e2-4d41-8fec-94b67bb2fc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f10521-ee1f-4866-b3aa-96fd91f05298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f10521-ee1f-4866-b3aa-96fd91f05298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8abc957-d126-453d-84eb-22d3e5a892be', 'volume_name': 'volume-e8abc957-d126-453d-84eb-22d3e5a892be', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580813c9-a3bd-4d68-ba90-971cc8609650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580813c9-a3bd-4d68-ba90-971cc8609650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743fb44-d7d1-49f9-a34c-81ef3eb0a326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Volume e8abc957-d126-453d-84eb-22d3e5a892be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8abc957-d126-453d-84eb-22d3e5a892be', 'volume_size': 1} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:05 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7" returned: 0 in 0.246s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.692s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Creating offline snapshot d970e22d-e608-48f6-b5d0-4994fd3d6de0 of volume 05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a0264d-de81-4bca-aa2b-c6de85a627f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4a8a49-9681-4ae0-84c9-27155aa9c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a9a55-74b9-4f80-b78c-6a5aaa8b5cba]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Volume volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 (31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7): created successfully Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4a8a49-9681-4ae0-84c9-27155aa9c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Flow 'volume_create_manager' (e6056329-8e49-4244-b846-59151a976a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f5461c75-a54b-418b-a5ad-f9cc4f5ead53 tempest-VolumesTransfersV357Test-1673377659 None] Created volume successfully. Jul 31 07:28:05 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 Jul 31 07:28:05 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:05 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8" returned: 0 in 0.344s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:05 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 1G Jul 31 07:28:05 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:06 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 1G" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05dda606-4173-426f-9841-e7dbe4c9cba8 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:06 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05dda606-4173-426f-9841-e7dbe4c9cba8 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 Jul 31 07:28:06 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:06 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05dda606-4173-426f-9841-e7dbe4c9cba8 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0" returned: 0 in 0.327s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:06 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 is being set with open permissions: ugo+rw Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:06 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 Jul 31 07:28:06 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:06 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:06 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.info Jul 31 07:28:06 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-64196ea9-a87c-407d-a98e-6a2d10c63aba tempest-VolumesTransfersV357Test-583538908 None] Transfer volume completed successfully. Jul 31 07:28:06 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.info" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:06 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.info is being set with open permissions: ugo+rw Jul 31 07:28:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:06 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.info Jul 31 07:28:06 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:07 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.info" returned: 0 in 0.274s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354360968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8abc957-d126-453d-84eb-22d3e5a892be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:05Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Creating volume e8abc957-d126-453d-84eb-22d3e5a892be {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:07 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:07 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be 1073741824 Jul 31 07:28:07 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Acquiring lock "cinder-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:07 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-8947441c-e19e-442a-b523-40104c7424b6 req-b23a0857-c341-49c8-96f0-45d479c65623 tempest-VolumesSnapshotsTestJSON-601216672 None] Create snapshot completed successfully Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Acquiring lock "cinder-quobyte-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-quobyte-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6097b0ca-196f-4f5c-918c-b5634abe3dd4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:07 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 Jul 31 07:28:07 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:07 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be 1073741824" returned: 0 in 0.452s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:07 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be Jul 31 07:28:07 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:07 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7" returned: 0 in 0.367s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:07 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7 Jul 31 07:28:07 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:07 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be" returned: 0 in 0.247s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743fb44-d7d1-49f9-a34c-81ef3eb0a326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8abc957-d126-453d-84eb-22d3e5a892be', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afacb686-ce85-4d8a-be7d-0d3f2d54d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:08 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Volume volume-e8abc957-d126-453d-84eb-22d3e5a892be (e8abc957-d126-453d-84eb-22d3e5a892be): created successfully Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afacb686-ce85-4d8a-be7d-0d3f2d54d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (734faf2b-a982-4def-a537-02b17ff6f760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:08 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4cada421-4a52-48e1-b98b-5f3c368d4de3 tempest-VolumesActionsTest-373251439 None] Created volume successfully. Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-quobyte-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7" released by "delete_volume" :: held 0.665s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Created reservations ['23a4b9e7-46b6-416a-ae0a-4ad903d22cba', 'c0232478-911c-4170-972e-8a8db2384087', '0b76c18e-ae0d-42b1-a32d-5a88219b8413', '4cf44e18-e730-4bf0-9ecf-21f55c6c0433'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:08 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:08 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "cinder-d970e22d-e608-48f6-b5d0-4994fd3d6de0-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-d970e22d-e608-48f6-b5d0-4994fd3d6de0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "cinder-quobyte-05dda606-4173-426f-9841-e7dbe4c9cba8" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-quobyte-05dda606-4173-426f-9841-e7dbe4c9cba8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "cinder-quobyte-d970e22d-e608-48f6-b5d0-4994fd3d6de0" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-quobyte-d970e22d-e608-48f6-b5d0-4994fd3d6de0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Deleting offline snapshot d970e22d-e608-48f6-b5d0-4994fd3d6de0 of volume 05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] snapshot_file for this snap is: volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53eea3f-18f1-414a-9d39-fc3cf5ed34a2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-e8abc957-d126-453d-84eb-22d3e5a892be-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-e8abc957-d126-453d-84eb-22d3e5a892be-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:08 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.352s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:08 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 Jul 31 07:28:08 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Deleted volume successfully. Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3b468385-3e4b-4ec4-bbb7-af30d2ac74c2 tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-31ec8ce2-4a2c-40e0-84ae-1def12f5b5d7-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-quobyte-e8abc957-d126-453d-84eb-22d3e5a892be" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-e8abc957-d126-453d-84eb-22d3e5a892be" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a5085-ecbf-4067-a16e-31768660bb8b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:08 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be Jul 31 07:28:08 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:08 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0" returned: 0 in 0.465s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05dda606-4173-426f-9841-e7dbe4c9cba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8222ae0-5849-4739-a6bf-74f18dd8f93a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:09 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 Jul 31 07:28:09 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:09 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Flow 'volume_create_manager' (5812523f-54f8-4e5c-82aa-e08d5fc6b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b463e5c-d1ff-4852-84f8-e5c035307b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be" returned: 0 in 0.447s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b463e5c-d1ff-4852-84f8-e5c035307b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1432102538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea920800-72ff-460f-80d2-ff3c788d1149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222c9ec1a20c4318a1c7d5dca1e99801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:09Z,use_quota=True,user_id='5893e04738f54ff5814c9a816a64dcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:09 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be Jul 31 07:28:09 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee43668-3e3e-46d5-bc78-6f54bc6472b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee43668-3e3e-46d5-bc78-6f54bc6472b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359ce5af-c106-4365-8d59-ce55c749c049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359ce5af-c106-4365-8d59-ce55c749c049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea920800-72ff-460f-80d2-ff3c788d1149', 'volume_name': 'volume-ea920800-72ff-460f-80d2-ff3c788d1149', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34437e8-d03c-4fad-966e-22ff22f95be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34437e8-d03c-4fad-966e-22ff22f95be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11268d46-341a-497f-9306-aea150a66779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Volume ea920800-72ff-460f-80d2-ff3c788d1149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea920800-72ff-460f-80d2-ff3c788d1149', 'volume_size': 1} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1432102538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea920800-72ff-460f-80d2-ff3c788d1149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222c9ec1a20c4318a1c7d5dca1e99801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:09Z,use_quota=True,user_id='5893e04738f54ff5814c9a816a64dcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Creating volume ea920800-72ff-460f-80d2-ff3c788d1149 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:09 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:09 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 1073741824 Jul 31 07:28:09 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:09 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8" returned: 0 in 0.405s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:09 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 Jul 31 07:28:09 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:09 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e8abc957-d126-453d-84eb-22d3e5a892be" returned: 0 in 0.251s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-e8abc957-d126-453d-84eb-22d3e5a892be" released by "delete_volume" :: held 0.739s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Created reservations ['2eb250b9-c569-48b3-9d59-c26785404401', '121df0e4-beb7-4023-be6e-b9fdb551599d', '8c81aa05-0e22-4718-89d7-23aa24a6fa97', '19fd8250-8414-458d-994a-1535d300126e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:09 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:09 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:09 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 1073741824" returned: 0 in 0.496s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:09 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0" returned: 0 in 0.379s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:09 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0 Jul 31 07:28:09 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:09 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 Jul 31 07:28:09 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:09 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.320s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Deleted volume successfully. Jul 31 07:28:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8f95609-4b6d-4b3a-bfa2-4b4d63046ef1 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-e8abc957-d126-453d-84eb-22d3e5a892be-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:09 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8.d970e22d-e608-48f6-b5d0-4994fd3d6de0" returned: 0 in 0.306s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:10 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149" returned: 0 in 0.333s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-quobyte-d970e22d-e608-48f6-b5d0-4994fd3d6de0" released by "_delete_snapshot" :: held 1.718s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11268d46-341a-497f-9306-aea150a66779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea920800-72ff-460f-80d2-ff3c788d1149', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe8fd1-0ee2-40b9-a5d9-04ef2d424040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-quobyte-05dda606-4173-426f-9841-e7dbe4c9cba8" released by "delete_snapshot" :: held 1.759s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Volume volume-ea920800-72ff-460f-80d2-ff3c788d1149 (ea920800-72ff-460f-80d2-ff3c788d1149): created successfully Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe8fd1-0ee2-40b9-a5d9-04ef2d424040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Flow 'volume_create_manager' (5812523f-54f8-4e5c-82aa-e08d5fc6b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6061557f-b318-41b0-b317-e500ba2e1826 tempest-VolumesTransfersV357Test-1673377659 None] Created volume successfully. Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.quota [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Created reservations ['b1ceec6f-64ae-402f-becb-462c001c124e', '858783b9-ac65-4106-92b9-61485334dc61', 'b4f03698-b924-415b-b312-940f5c2f298f', '708ecf3e-2dbc-4b31-bd58-1c1339234bfc'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Delete snapshot completed successfully. Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-397bb1c8-03dc-4776-b44d-a99bfd6f42cc req-0882f525-a504-4adc-817d-7208d665008f tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-d970e22d-e608-48f6-b5d0-4994fd3d6de0-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (b0b2ed48-9245-4ace-95ba-5b6ebb253892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52400dc6-e377-4ec6-bdd2-68419d54767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52400dc6-e377-4ec6-bdd2-68419d54767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003407743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63856b55-92f7-4446-bf4d-3f843c4c12ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:10Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb06355-1826-471a-a478-add1ad3ea92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb06355-1826-471a-a478-add1ad3ea92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e74188-3854-48e1-9972-62dba7f103d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e74188-3854-48e1-9972-62dba7f103d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63856b55-92f7-4446-bf4d-3f843c4c12ff', 'volume_name': 'volume-63856b55-92f7-4446-bf4d-3f843c4c12ff', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fb89a8-6d43-4cb1-af9e-45a29c9ba692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fb89a8-6d43-4cb1-af9e-45a29c9ba692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07353aa7-a23c-4709-aee6-2c7c5e00efc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Volume 63856b55-92f7-4446-bf4d-3f843c4c12ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63856b55-92f7-4446-bf4d-3f843c4c12ff', 'volume_size': 1} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003407743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63856b55-92f7-4446-bf4d-3f843c4c12ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:10Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Creating volume 63856b55-92f7-4446-bf4d-3f843c4c12ff {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:10 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:10 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff 1073741824 Jul 31 07:28:10 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "cinder-05dda606-4173-426f-9841-e7dbe4c9cba8-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-05dda606-4173-426f-9841-e7dbe4c9cba8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "cinder-quobyte-05dda606-4173-426f-9841-e7dbe4c9cba8" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-quobyte-05dda606-4173-426f-9841-e7dbe4c9cba8" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d6195-476c-4deb-bab9-11824eb6e3da]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:10 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff 1073741824" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:10 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 Jul 31 07:28:10 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:10 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff Jul 31 07:28:10 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:11 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8" returned: 0 in 0.352s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:11 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff" returned: 0 in 0.246s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:11 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8 Jul 31 07:28:11 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07353aa7-a23c-4709-aee6-2c7c5e00efc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63856b55-92f7-4446-bf4d-3f843c4c12ff', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3d5470-0739-4b1a-b3be-eb4b7468c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:11 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Volume volume-63856b55-92f7-4446-bf4d-3f843c4c12ff (63856b55-92f7-4446-bf4d-3f843c4c12ff): created successfully Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3d5470-0739-4b1a-b3be-eb4b7468c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (b0b2ed48-9245-4ace-95ba-5b6ebb253892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d2bf32c4-a3c1-40bd-9768-4e599e8c212a tempest-VolumesActionsTest-373251439 None] Created volume successfully. Jul 31 07:28:11 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05dda606-4173-426f-9841-e7dbe4c9cba8" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-quobyte-05dda606-4173-426f-9841-e7dbe4c9cba8" released by "delete_volume" :: held 0.701s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.quota [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Created reservations ['cbc669b3-cf68-48c9-a790-1685aaf8d6e1', 'dbdcdefe-ad11-40d5-9965-91a5fcb8fbc3', '50df6839-2425-4296-899a-2c98b88d5741', '37bb6579-bff2-4fea-a6af-ba7ffbe544ec'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-63856b55-92f7-4446-bf4d-3f843c4c12ff-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-63856b55-92f7-4446-bf4d-3f843c4c12ff-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Acquiring lock "cinder-ea920800-72ff-460f-80d2-ff3c788d1149-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:11 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:11 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-ea920800-72ff-460f-80d2-ff3c788d1149-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-quobyte-63856b55-92f7-4446-bf4d-3f843c4c12ff" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-63856b55-92f7-4446-bf4d-3f843c4c12ff" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Acquiring lock "cinder-quobyte-ea920800-72ff-460f-80d2-ff3c788d1149" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[17284918-28b7-40fb-a503-a25f212d16cc]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-quobyte-ea920800-72ff-460f-80d2-ff3c788d1149" acquired by "delete_volume" :: waited 0.041s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[666acb37-0d24-4d5c-b26e-351bf621d4dc]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:11 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 Jul 31 07:28:11 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:11 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff Jul 31 07:28:11 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:11 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.manager [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Deleted volume successfully. Jul 31 07:28:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-c0b3da40-ee2e-4076-87bc-a1fd381959dc req-a1be4adb-c544-4f34-88a6-d2d6b2aeba64 tempest-VolumesSnapshotsTestJSON-601216672 None] Lock "cinder-05dda606-4173-426f-9841-e7dbe4c9cba8-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:12 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff" returned: 0 in 0.485s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:12 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149" returned: 0 in 0.441s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:12 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff Jul 31 07:28:12 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:12 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149 Jul 31 07:28:12 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:12 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63856b55-92f7-4446-bf4d-3f843c4c12ff" returned: 0 in 0.298s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-63856b55-92f7-4446-bf4d-3f843c4c12ff" released by "delete_volume" :: held 0.842s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:12 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ea920800-72ff-460f-80d2-ff3c788d1149" returned: 0 in 0.317s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-quobyte-ea920800-72ff-460f-80d2-ff3c788d1149" released by "delete_volume" :: held 0.824s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Created reservations ['a01eba35-1470-4ece-a6d2-2965c9360ad2', '9e10f1aa-53ed-4635-b970-1ed87306fe9f', '538b5f61-e825-4f21-91d7-373ca59270b8', 'aaecc038-468b-4ee8-9d33-259748a40838'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Created reservations ['5496b0d4-30c5-4c45-a556-228f3d536b93', '63bbbb17-15e3-4b0a-816a-ef08f5924681', '3942d2d6-1337-452f-a0f7-9162210b99bd', 'fb6e1e46-d4f6-4d40-97ed-4ad0aa391134'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:12 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:12 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:12 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:12 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:13 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.310s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:13 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Deleted volume successfully. Jul 31 07:28:13 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.276s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:13 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Deleted volume successfully. Jul 31 07:28:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08d5c642-553b-4e51-8cc5-38b99815df49 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-63856b55-92f7-4446-bf4d-3f843c4c12ff-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2cc545eb-f9a7-4cf4-874d-b6b3dab1647b tempest-VolumesTransfersV357Test-66925530 None] Lock "cinder-ea920800-72ff-460f-80d2-ff3c788d1149-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (9545fe9b-a5c6-475a-b326-415253a5c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3713bc-c303-4481-9141-bfa9a0f11268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3713bc-c303-4481-9141-bfa9a0f11268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123515734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b090881-5b97-4271-88fa-06aa8669323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:14Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22bf7b3-4b23-44c9-b1c5-bf03c306122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22bf7b3-4b23-44c9-b1c5-bf03c306122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9d4e84-c0e7-4657-8f88-ce6eb79e8991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9d4e84-c0e7-4657-8f88-ce6eb79e8991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b090881-5b97-4271-88fa-06aa8669323a', 'volume_name': 'volume-9b090881-5b97-4271-88fa-06aa8669323a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d56ef33-3ea4-4684-819a-4a3312abb4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d56ef33-3ea4-4684-819a-4a3312abb4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c820c558-0836-471a-8003-96be21cf08d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Volume 9b090881-5b97-4271-88fa-06aa8669323a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b090881-5b97-4271-88fa-06aa8669323a', 'volume_size': 1} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123515734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b090881-5b97-4271-88fa-06aa8669323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:14Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Creating volume 9b090881-5b97-4271-88fa-06aa8669323a {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:14 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:14 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a 1073741824 Jul 31 07:28:14 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:14 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a 1073741824" returned: 0 in 0.456s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:15 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a Jul 31 07:28:15 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:15 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a" returned: 0 in 0.256s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c820c558-0836-471a-8003-96be21cf08d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b090881-5b97-4271-88fa-06aa8669323a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d26be5-4a0f-4408-8286-99df406ea47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Volume volume-9b090881-5b97-4271-88fa-06aa8669323a (9b090881-5b97-4271-88fa-06aa8669323a): created successfully Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d26be5-4a0f-4408-8286-99df406ea47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (9545fe9b-a5c6-475a-b326-415253a5c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9c5c1c8d-8e3e-4d78-a314-a8ae5bc1d636 tempest-VolumesActionsTest-373251439 None] Created volume successfully. Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-9b090881-5b97-4271-88fa-06aa8669323a-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Lock "cinder-9b090881-5b97-4271-88fa-06aa8669323a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-quobyte-9b090881-5b97-4271-88fa-06aa8669323a" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-9b090881-5b97-4271-88fa-06aa8669323a" acquired by "delete_volume" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c1dd0d-f995-4d29-a369-67a2fada6fa1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:16 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a Jul 31 07:28:16 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:16 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a" returned: 0 in 0.503s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:16 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a Jul 31 07:28:16 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Flow 'volume_create_manager' (59a13e9c-91f1-481b-933f-015f14b63ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bd5fc7-4f43-41f6-a362-40281f256920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bd5fc7-4f43-41f6-a362-40281f256920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-119124468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4c295fdac4749ab628c9aac64e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:17Z,use_quota=True,user_id='7d190d7ba3324db593887cb068d445fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9643bb44-bf03-4016-98d8-6a2cd42bab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9643bb44-bf03-4016-98d8-6a2cd42bab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5680ef0-bfb8-4dcb-bff4-cc5309e01b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5680ef0-bfb8-4dcb-bff4-cc5309e01b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8', 'volume_name': 'volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8a6a99-8d11-4309-aad6-33692f1d51e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8a6a99-8d11-4309-aad6-33692f1d51e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a211f696-2969-4835-8648-8ef6f2603fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Volume 5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8', 'volume_size': 1} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-119124468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4c295fdac4749ab628c9aac64e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:17Z,use_quota=True,user_id='7d190d7ba3324db593887cb068d445fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Creating volume 5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:16 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:16 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 1073741824 Jul 31 07:28:16 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:16 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9b090881-5b97-4271-88fa-06aa8669323a" returned: 0 in 0.423s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-9b090881-5b97-4271-88fa-06aa8669323a" released by "delete_volume" :: held 1.000s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Created reservations ['1dbf9ff6-3185-4b86-b2c5-876d31c4ef0e', '481e9d53-383d-4dbf-8e0f-314933126e9a', '8b1da495-84c0-4e0d-abd1-b60b25dcc7df', '573dd8b8-e8ed-40bf-b470-c961510423e1'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Flow 'volume_create_manager' (4bcb8ba6-b8e8-4fca-8409-0df3345c765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0902e262-24ce-4f48-8d42-a8f3624d9454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0902e262-24ce-4f48-8d42-a8f3624d9454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2057770845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d7b327-90a6-474e-829a-18d5bb317eb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f32ed353d987439c8a6cf9a0809d6273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:17Z,use_quota=True,user_id='39b561d1bb4641d580bbc52f7cb5d910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b46e537-90ed-49ae-9e65-f0309d770273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b46e537-90ed-49ae-9e65-f0309d770273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b59a4c-d6e9-4df2-80f3-a9e3cbc4a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b59a4c-d6e9-4df2-80f3-a9e3cbc4a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d7b327-90a6-474e-829a-18d5bb317eb1', 'volume_name': 'volume-17d7b327-90a6-474e-829a-18d5bb317eb1', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8930e0bf-9229-477c-a5e5-6160c66b18a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8930e0bf-9229-477c-a5e5-6160c66b18a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96c3d1e-2d3c-4657-8b59-860a552c6624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:17 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Volume 17d7b327-90a6-474e-829a-18d5bb317eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d7b327-90a6-474e-829a-18d5bb317eb1', 'volume_size': 1} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:17 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:17 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:17 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 1073741824" returned: 0 in 0.577s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:17 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 Jul 31 07:28:17 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:17 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.334s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Deleted volume successfully. Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-944ddee6-46bf-4af1-b715-ad668ba0792c tempest-VolumesActionsTest-1754265096 None] Lock "cinder-9b090881-5b97-4271-88fa-06aa8669323a-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:17 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8" returned: 0 in 0.299s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2057770845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d7b327-90a6-474e-829a-18d5bb317eb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f32ed353d987439c8a6cf9a0809d6273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:17Z,use_quota=True,user_id='39b561d1bb4641d580bbc52f7cb5d910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Creating volume 17d7b327-90a6-474e-829a-18d5bb317eb1 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:17 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:17 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 1073741824 Jul 31 07:28:17 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a211f696-2969-4835-8648-8ef6f2603fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd330b8-805f-4a03-87bc-1079ebec53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:17 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Volume volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 (5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8): created successfully Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd330b8-805f-4a03-87bc-1079ebec53be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Flow 'volume_create_manager' (59a13e9c-91f1-481b-933f-015f14b63ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e8d5f502-62ed-46ef-bea3-91e02198fb81 tempest-AttachVolumeNegativeTest-1195133799 None] Created volume successfully. Jul 31 07:28:18 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 1073741824" returned: 0 in 0.503s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:18 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 Jul 31 07:28:18 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:18 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1" returned: 0 in 0.323s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96c3d1e-2d3c-4657-8b59-860a552c6624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d7b327-90a6-474e-829a-18d5bb317eb1', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c7aa59-a591-4384-b293-6104990044da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Volume volume-17d7b327-90a6-474e-829a-18d5bb317eb1 (17d7b327-90a6-474e-829a-18d5bb317eb1): created successfully Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c7aa59-a591-4384-b293-6104990044da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Flow 'volume_create_manager' (4bcb8ba6-b8e8-4fca-8409-0df3345c765e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-39cb4538-84f0-43ee-8a8f-a23ec81220de req-2437eebd-154c-4e9b-bdf2-dd97adfe3019 tempest-VolumesGetTestJSON-1226022771 None] Created volume successfully. Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (f3964307-7e90-4d3f-92dc-4689605bd6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8db7220-c002-4feb-9feb-3a57d5817435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8db7220-c002-4feb-9feb-3a57d5817435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72890537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b256bbf6-0640-4207-b395-fb079dbe365c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:19Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bc8fc5-ec5f-46be-b6f7-7b82d3652eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bc8fc5-ec5f-46be-b6f7-7b82d3652eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c991bd3b-fcef-4877-ac27-7858825410ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c991bd3b-fcef-4877-ac27-7858825410ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b256bbf6-0640-4207-b395-fb079dbe365c', 'volume_name': 'volume-b256bbf6-0640-4207-b395-fb079dbe365c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b8a3f5-ef0c-4948-93aa-9a90c5d0c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b8a3f5-ef0c-4948-93aa-9a90c5d0c124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7403d5e3-77f9-4998-b57f-8c59ed082a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Volume b256bbf6-0640-4207-b395-fb079dbe365c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b256bbf6-0640-4207-b395-fb079dbe365c', 'volume_size': 1} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72890537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b256bbf6-0640-4207-b395-fb079dbe365c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:19Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Creating volume b256bbf6-0640-4207-b395-fb079dbe365c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:18 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:19 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c 1073741824 Jul 31 07:28:19 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:19 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c 1073741824" returned: 0 in 0.524s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:19 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c Jul 31 07:28:19 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Acquiring lock "cinder-17d7b327-90a6-474e-829a-18d5bb317eb1-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Lock "cinder-17d7b327-90a6-474e-829a-18d5bb317eb1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Acquiring lock "cinder-quobyte-17d7b327-90a6-474e-829a-18d5bb317eb1" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Lock "cinder-quobyte-17d7b327-90a6-474e-829a-18d5bb317eb1" acquired by "delete_volume" :: waited 0.036s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d4914-846d-4d6e-b9f7-f61ca3ae4647]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:20 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c" returned: 0 in 0.462s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:20 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 Jul 31 07:28:20 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7403d5e3-77f9-4998-b57f-8c59ed082a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b256bbf6-0640-4207-b395-fb079dbe365c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b9e5c2-05ab-4705-b40e-e43f9705ba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-bec6ab82-cfea-44a4-b115-b472727f23df req-035e4e3b-de27-4ace-81e1-c4e76823d999 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-bec6ab82-cfea-44a4-b115-b472727f23df req-035e4e3b-de27-4ace-81e1-c4e76823d999 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:20 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Volume volume-b256bbf6-0640-4207-b395-fb079dbe365c (b256bbf6-0640-4207-b395-fb079dbe365c): created successfully Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b9e5c2-05ab-4705-b40e-e43f9705ba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (f3964307-7e90-4d3f-92dc-4689605bd6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-bec6ab82-cfea-44a4-b115-b472727f23df req-035e4e3b-de27-4ace-81e1-c4e76823d999 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:20 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-257ddf68-e403-4610-8b07-8f839b4e18aa tempest-VolumesActionsTest-373251439 None] Created volume successfully. Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-bec6ab82-cfea-44a4-b115-b472727f23df req-035e4e3b-de27-4ace-81e1-c4e76823d999 tempest-AttachVolumeNegativeTest-1195133799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e42d11bc-d9f0-4cbf-83e7-9124525a3199', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:28:20 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-bec6ab82-cfea-44a4-b115-b472727f23df req-035e4e3b-de27-4ace-81e1-c4e76823d999 tempest-AttachVolumeNegativeTest-1195133799 None] attachment_update completed successfully. Jul 31 07:28:20 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1" returned: 0 in 0.442s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:20 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1 Jul 31 07:28:20 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:20 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-17d7b327-90a6-474e-829a-18d5bb317eb1" returned: 0 in 0.280s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Lock "cinder-quobyte-17d7b327-90a6-474e-829a-18d5bb317eb1" released by "delete_volume" :: held 0.804s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.quota [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Created reservations ['f2e226f2-7718-46b7-b997-dcf036fa43c6', 'db5f5d03-6eec-414c-a306-f6bda41b1cf3', '7a52e4eb-e75d-4ca0-914c-3a5876662ac9', '91875b74-b736-43e1-9488-43c63c80e225'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:20 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:20 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:21 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.434s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.manager [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Deleted volume successfully. Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-91ce8005-b7ac-46ff-a2f2-5f09aa994e25 req-c4a63b45-1ac4-489f-9b8e-f0a766f2e470 tempest-VolumesGetTestJSON-1226022771 None] Lock "cinder-17d7b327-90a6-474e-829a-18d5bb317eb1-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Flow 'volume_create_manager' (6746b105-3f47-4ace-921b-fe4638454705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7558ccb9-4dfe-4c8d-bb46-8eedc9add6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7558ccb9-4dfe-4c8d-bb46-8eedc9add6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1164578255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c207d047-da81-4418-8596-afa5c9298ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4292cffa604ba5adf08fde03c23a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:21Z,use_quota=True,user_id='c47d785f5d4a4b40881a18e78331b2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9879d8a0-6bbd-4caf-a5bc-9e860d31efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9879d8a0-6bbd-4caf-a5bc-9e860d31efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9742be60-edb6-483d-8814-79b437c3d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9742be60-edb6-483d-8814-79b437c3d44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c207d047-da81-4418-8596-afa5c9298ace', 'volume_name': 'volume-c207d047-da81-4418-8596-afa5c9298ace', 'volume_size': 2}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0740ae-4d09-4f40-92a0-5c4b7824d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0740ae-4d09-4f40-92a0-5c4b7824d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edda7af0-967f-48bf-8ffb-c884d87cf836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:21 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Volume c207d047-da81-4418-8596-afa5c9298ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c207d047-da81-4418-8596-afa5c9298ace', 'volume_size': 2} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1164578255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c207d047-da81-4418-8596-afa5c9298ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4292cffa604ba5adf08fde03c23a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:21Z,use_quota=True,user_id='c47d785f5d4a4b40881a18e78331b2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Creating volume c207d047-da81-4418-8596-afa5c9298ace {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:21 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace 2147483648 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-b256bbf6-0640-4207-b395-fb079dbe365c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:21 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace 2147483648 Jul 31 07:28:21 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-b256bbf6-0640-4207-b395-fb079dbe365c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "cinder-quobyte-b256bbf6-0640-4207-b395-fb079dbe365c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-b256bbf6-0640-4207-b395-fb079dbe365c" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c352e0-65a1-4529-9540-e33705db7794]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:21 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c Jul 31 07:28:21 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:21 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c" returned: 0 in 0.410s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:21 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c Jul 31 07:28:21 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:22 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace 2147483648" returned: 0 in 0.630s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:22 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace Jul 31 07:28:22 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:22 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b256bbf6-0640-4207-b395-fb079dbe365c" returned: 0 in 0.280s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-quobyte-b256bbf6-0640-4207-b395-fb079dbe365c" released by "delete_volume" :: held 0.744s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Created reservations ['933657b7-56a4-479e-ade6-a9b3acb00fdc', 'bde84a05-8348-449e-bfd3-e7092ee5a606', '8d2592eb-e4ea-4f8d-a066-485f42e7f85e', '4763bf01-4c38-4fa6-871e-4822c931d1b5'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:22 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace" returned: 0 in 0.331s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edda7af0-967f-48bf-8ffb-c884d87cf836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c207d047-da81-4418-8596-afa5c9298ace', 'volume_size': 2}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0d81db-be42-4bff-987b-53fb64b969b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:22 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Volume volume-c207d047-da81-4418-8596-afa5c9298ace (c207d047-da81-4418-8596-afa5c9298ace): created successfully Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0d81db-be42-4bff-987b-53fb64b969b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Flow 'volume_create_manager' (6746b105-3f47-4ace-921b-fe4638454705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-393829ae-6df5-4c09-9112-2b9166690c0d tempest-VolumesCloneNegativeTest-1107641980 None] Created volume successfully. Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:22 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:22 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:23 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.418s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Deleted volume successfully. Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e96133b0-70f0-4213-af7a-053c676ad109 tempest-VolumesActionsTest-1754265096 None] Lock "cinder-b256bbf6-0640-4207-b395-fb079dbe365c-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-837afab3-496e-408e-b235-69e17ab50592 req-d54ff868-e66d-4d33-be1d-16adc36b6140 tempest-AttachVolumeNegativeTest-1195133799 None] Terminate volume connection completed successfully. Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-837afab3-496e-408e-b235-69e17ab50592 req-d54ff868-e66d-4d33-be1d-16adc36b6140 tempest-AttachVolumeNegativeTest-1195133799 None] Deleting attachment e42d11bc-d9f0-4cbf-83e7-9124525a3199. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (b6299156-5d82-451f-9c86-7fcfa73ecf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cca128-c1d4-4bb1-97be-ff7811299204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cca128-c1d4-4bb1-97be-ff7811299204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-823973043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87a52f8-89c2-42c8-a79e-d266164466d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:23Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08d8699-7da7-4fad-bbe2-1e574de84278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08d8699-7da7-4fad-bbe2-1e574de84278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e70a7f-568e-47ec-926a-5a8d5439f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e70a7f-568e-47ec-926a-5a8d5439f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87a52f8-89c2-42c8-a79e-d266164466d8', 'volume_name': 'volume-e87a52f8-89c2-42c8-a79e-d266164466d8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4501da8-13e0-4e7b-b20f-43ae491841ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4501da8-13e0-4e7b-b20f-43ae491841ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9342679-572f-4d1d-b8dc-34fcf483a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:23 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Volume e87a52f8-89c2-42c8-a79e-d266164466d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87a52f8-89c2-42c8-a79e-d266164466d8', 'volume_size': 1} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-823973043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87a52f8-89c2-42c8-a79e-d266164466d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98f683638d54624bb20afff78cfba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:23Z,use_quota=True,user_id='86f289088e754ad6b58340f43f386ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Creating volume e87a52f8-89c2-42c8-a79e-d266164466d8 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:23 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:23 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 1073741824 Jul 31 07:28:23 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Acquiring lock "cinder-c207d047-da81-4418-8596-afa5c9298ace-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Lock "cinder-c207d047-da81-4418-8596-afa5c9298ace-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Acquiring lock "cinder-quobyte-c207d047-da81-4418-8596-afa5c9298ace" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Lock "cinder-quobyte-c207d047-da81-4418-8596-afa5c9298ace" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b1e648-f713-4ace-bf70-57637e6a16da]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:24 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace Jul 31 07:28:24 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:24 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 1073741824" returned: 0 in 0.668s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:24 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 Jul 31 07:28:24 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:24 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace" returned: 0 in 0.596s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:24 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace Jul 31 07:28:24 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:24 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8" returned: 0 in 0.546s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9342679-572f-4d1d-b8dc-34fcf483a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87a52f8-89c2-42c8-a79e-d266164466d8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd264543-2803-434a-a981-3d27191e4b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:25 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Volume volume-e87a52f8-89c2-42c8-a79e-d266164466d8 (e87a52f8-89c2-42c8-a79e-d266164466d8): created successfully Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd264543-2803-434a-a981-3d27191e4b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:25 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Flow 'volume_create_manager' (b6299156-5d82-451f-9c86-7fcfa73ecf41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c207d047-da81-4418-8596-afa5c9298ace" returned: 0 in 0.474s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0bff94ed-4096-4f20-9e70-eaf9f9495887 tempest-VolumesActionsTest-373251439 None] Created volume successfully. Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Lock "cinder-quobyte-c207d047-da81-4418-8596-afa5c9298ace" released by "delete_volume" :: held 1.151s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Created reservations ['d91b91e7-cdfc-4568-872b-8e66cd1ff59d', 'e23e7542-b065-48dc-a704-7403dc577bbf', '740b461b-84cb-4a62-901b-34c8318dbc83', '5d7354d7-a756-4862-abf0-aede7d12fc1a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:25 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:25 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:25 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.390s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Deleted volume successfully. Jul 31 07:28:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5d0cd257-3327-4c12-ad92-e63e8593a44b tempest-VolumesCloneNegativeTest-1107641980 None] Lock "cinder-c207d047-da81-4418-8596-afa5c9298ace-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Acquiring lock "cinder-e87a52f8-89c2-42c8-a79e-d266164466d8-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Lock "cinder-e87a52f8-89c2-42c8-a79e-d266164466d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Acquiring lock "cinder-quobyte-e87a52f8-89c2-42c8-a79e-d266164466d8" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Lock "cinder-quobyte-e87a52f8-89c2-42c8-a79e-d266164466d8" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:26 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[278218b8-1313-436f-ad42-a49dfffc7ec7]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:26 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 Jul 31 07:28:26 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:27 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8" returned: 0 in 0.554s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:27 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8 Jul 31 07:28:27 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:27 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e87a52f8-89c2-42c8-a79e-d266164466d8" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Lock "cinder-quobyte-e87a52f8-89c2-42c8-a79e-d266164466d8" released by "delete_volume" :: held 0.898s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Created reservations ['64e969d6-660b-485c-9f3a-fe87d4360525', 'de4e180c-7bfe-4aa7-b3ea-a44ea91cdafc', '36d85965-d9eb-487a-80f9-8d84c59021fd', '18e6a0a0-b3f1-4215-9f53-69edb7b9dfca'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:27 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:27 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:28 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:28 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Deleted volume successfully. Jul 31 07:28:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8d663cfe-004b-4e52-8462-c7cae1764f00 tempest-VolumesActionsTest-373251439 None] Lock "cinder-e87a52f8-89c2-42c8-a79e-d266164466d8-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Flow 'volume_create_manager' (6c09d4e9-434c-4183-b71d-8e4021ed0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161cc5d1-cab0-4b48-959c-8b3246e85f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161cc5d1-cab0-4b48-959c-8b3246e85f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-50007631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2788598-2fb3-4fdf-b359-c95f88d3e39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa31ed1c08f498d8e277805fde3e3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:31Z,use_quota=True,user_id='cda5b2ddaabc443a89dad5d86f154be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba3b2ee-1f2d-479d-965c-e372bbb8ba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba3b2ee-1f2d-479d-965c-e372bbb8ba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0553a5c-669d-46db-86c1-0f7392436226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:30 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0553a5c-669d-46db-86c1-0f7392436226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2788598-2fb3-4fdf-b359-c95f88d3e39d', 'volume_name': 'volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577072d0-fd7d-4c1b-83e3-ba2ba354f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577072d0-fd7d-4c1b-83e3-ba2ba354f13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd76143-772a-4dd8-95ee-3ead3b417d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:31 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Volume d2788598-2fb3-4fdf-b359-c95f88d3e39d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Trying to clone d2788598-2fb3-4fdf-b359-c95f88d3e39d from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:28:31 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Image download 20.69 MB at 20.69 MB/s Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465bf2f-9657-4d1d-8dc7-424accedd3a8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:32 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD Jul 31 07:28:32 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:32 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e is fetched for user cda5b2ddaabc443a89dad5d86f154be8. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7abd5b6-6003-45e8-89d8-659505e1197e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:32 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD Jul 31 07:28:32 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:32 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-50007631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2788598-2fb3-4fdf-b359-c95f88d3e39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa31ed1c08f498d8e277805fde3e3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:31Z,use_quota=True,user_id='cda5b2ddaabc443a89dad5d86f154be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Creating volume d2788598-2fb3-4fdf-b359-c95f88d3e39d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:32 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:33 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 1073741824 Jul 31 07:28:33 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:33 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 1073741824" returned: 0 in 0.609s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:33 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d Jul 31 07:28:33 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:33 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:33 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:34 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.340s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:28:34 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d" returned: 0 in 0.462s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Attempting download of 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume d2788598-2fb3-4fdf-b359-c95f88d3e39d. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb14392-c6b5-4441-aec1-12da13044f5c]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_132xf22p {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:34 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_132xf22p Jul 31 07:28:34 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:34 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_132xf22p" returned: 0 in 0.462s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_132xf22p {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:34 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_132xf22p Jul 31 07:28:34 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=130,cinder:INSERT=44,cinder:UPDATE=154,cinder:DELETE=12 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:28:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ed36615e-041d-493a-9c18-0bfd7a9758bc tempest-GroupsV314Test-746816283 None] Group tempest-GroupsV314Test-Group-1417736958: creating Jul 31 07:28:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ed36615e-041d-493a-9c18-0bfd7a9758bc tempest-GroupsV314Test-746816283 None] Group tempest-GroupsV314Test-Group-1417736958: created successfully Jul 31 07:28:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ed36615e-041d-493a-9c18-0bfd7a9758bc tempest-GroupsV314Test-746816283 None] Create group completed successfully. Jul 31 07:28:35 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_132xf22p" returned: 1 in 0.470s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_132xf22p' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c7dc4-11ab-4fb2-a895-b20274a8b12e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:35 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD Jul 31 07:28:35 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:35 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] 0c598684-d1fc-49c0-b0cf-3a02a6f8533e was qcow2, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:28:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:35 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d Jul 31 07:28:35 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Flow 'volume_create_manager' (cbf4f1ed-2e6b-4e1e-a98d-522de57b999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8051a5b-04c7-48c1-9b09-ac6dbc4fbfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8051a5b-04c7-48c1-9b09-ac6dbc4fbfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-784589095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4319d18b-f6ea-4300-8bcf-2c9e80b1cb36,host='devstack@QuobyteHD#QuobyteHD',id=5764e850-1cde-4d17-9c05-4591285368a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ead4ecc83234d9da2a1bf470887f31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:37Z,use_quota=True,user_id='24d3daa269934cf0a66e331159297401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceb05737-f3f0-4bc0-b224-3c7f609bbedf),volume_type_id=ceb05737-f3f0-4bc0-b224-3c7f609bbedf)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f0b24a-169c-4329-812b-c12ff28ec69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f0b24a-169c-4329-812b-c12ff28ec69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef3edfc-8435-4c11-b1ec-702524843cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef3edfc-8435-4c11-b1ec-702524843cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5764e850-1cde-4d17-9c05-4591285368a9', 'volume_name': 'volume-5764e850-1cde-4d17-9c05-4591285368a9', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448f623b-117c-41d7-ac96-b112a0aaad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448f623b-117c-41d7-ac96-b112a0aaad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211da74a-7e6f-49a4-bddc-726ddcdac6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:37 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Volume 5764e850-1cde-4d17-9c05-4591285368a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5764e850-1cde-4d17-9c05-4591285368a9', 'volume_size': 1} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4319d18b-f6ea-4300-8bcf-2c9e80b1cb36,created_at=2026-07-31T05:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-784589095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4319d18b-f6ea-4300-8bcf-2c9e80b1cb36,host='devstack@QuobyteHD#QuobyteHD',id=5764e850-1cde-4d17-9c05-4591285368a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ead4ecc83234d9da2a1bf470887f31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:37Z,use_quota=True,user_id='24d3daa269934cf0a66e331159297401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceb05737-f3f0-4bc0-b224-3c7f609bbedf),volume_type_id=ceb05737-f3f0-4bc0-b224-3c7f609bbedf)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Creating volume 5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:37 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:37 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 1073741824 Jul 31 07:28:37 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:37 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 1073741824" returned: 0 in 0.721s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:38 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 Jul 31 07:28:38 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:38 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d" returned: 0 in 2.566s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_jgv2pq2ldevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:28:38 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Converted 112.00 MB image at 43.63 MB/s Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:38 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 1G Jul 31 07:28:38 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:38 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9" returned: 0 in 0.382s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211da74a-7e6f-49a4-bddc-726ddcdac6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5764e850-1cde-4d17-9c05-4591285368a9', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8f48a6-1d93-41a8-98b3-7f8c0a058150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:38 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Volume volume-5764e850-1cde-4d17-9c05-4591285368a9 (5764e850-1cde-4d17-9c05-4591285368a9): created successfully Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8f48a6-1d93-41a8-98b3-7f8c0a058150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Flow 'volume_create_manager' (cbf4f1ed-2e6b-4e1e-a98d-522de57b999c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:38 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e22cfe04-58f8-4a29-b0bd-fc412f11ce2b tempest-GroupsV314Test-746816283 None] Created volume successfully. Jul 31 07:28:38 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 1G" returned: 0 in 0.417s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Downloaded image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume d2788598-2fb3-4fdf-b359-c95f88d3e39d successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e for user cda5b2ddaabc443a89dad5d86f154be8 is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Marking volume d2788598-2fb3-4fdf-b359-c95f88d3e39d as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Copying metadata from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e to d2788598-2fb3-4fdf-b359-c95f88d3e39d. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Creating volume glance metadata for volume d2788598-2fb3-4fdf-b359-c95f88d3e39d backed by image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd76143-772a-4dd8-95ee-3ead3b417d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf559222-fee4-4754-adc3-29d6c3cfe0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=171,cinder:SELECT=131,cinder:INSERT=51,cinder:DELETE=15 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:28:38 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Volume volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d (d2788598-2fb3-4fdf-b359-c95f88d3e39d): created successfully Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf559222-fee4-4754-adc3-29d6c3cfe0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Flow 'volume_create_manager' (6c09d4e9-434c-4183-b71d-8e4021ed0b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:38 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-18f571eb-925c-43cd-8a0a-d6325b10fcd3 tempest-VolumesExtendTest-1738599844 None] Created volume successfully. Jul 31 07:28:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8396c2b9-6271-4052-bfc7-277d487f7497]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:40 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d Jul 31 07:28:40 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:40 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d" returned: 0 in 0.870s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 2G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d 2G" returned: 0 in 0.195s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.113s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.070s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:40 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Cloning volume 5764e850-1cde-4d17-9c05-4591285368a9 to volume 8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 Jul 31 07:28:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Creating offline snapshot d376a60a-5070-4afd-b9ea-676089205c6a of volume 5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:28:41 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2ab0b128-a34c-4cc9-8014-cf31212da8bf tempest-VolumesExtendTest-1738599844 None] Extend volume completed successfully. Jul 31 07:28:41 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a0ef6-b30c-4385-8044-ded8e62c2e91]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:41 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 Jul 31 07:28:41 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:41 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9" returned: 0 in 0.461s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:41 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a 1G Jul 31 07:28:41 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:42 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a 1G" returned: 0 in 0.604s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5764e850-1cde-4d17-9c05-4591285368a9 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:42 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5764e850-1cde-4d17-9c05-4591285368a9 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a Jul 31 07:28:42 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "cinder-d2788598-2fb3-4fdf-b359-c95f88d3e39d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-d2788598-2fb3-4fdf-b359-c95f88d3e39d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "cinder-quobyte-d2788598-2fb3-4fdf-b359-c95f88d3e39d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-d2788598-2fb3-4fdf-b359-c95f88d3e39d" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ebcde-8863-43fb-9287-b1c5b5f51d54]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:42 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5764e850-1cde-4d17-9c05-4591285368a9 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a" returned: 0 in 0.587s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:42 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:42 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a Jul 31 07:28:42 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:42 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d Jul 31 07:28:42 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:42 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a" returned: 0 in 0.297s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:43 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.info Jul 31 07:28:43 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:43 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d" returned: 0 in 0.564s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:43 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d Jul 31 07:28:43 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:43 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.info" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:43 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:43 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.info Jul 31 07:28:43 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:43 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2788598-2fb3-4fdf-b359-c95f88d3e39d" returned: 0 in 0.433s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-d2788598-2fb3-4fdf-b359-c95f88d3e39d" released by "delete_volume" :: held 1.059s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Created reservations ['8d63ad4a-93e0-4731-b25f-a3b94f718668', 'c9763354-7e21-4604-973a-c8fc16e10597', '31cb2c58-12ba-4022-a8ac-c2be44068207', '4e349565-a6cf-4b12-acd1-03b572751c40'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:43 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.info" returned: 0 in 0.458s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Acquiring lock "cinder-quobyte-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] snapshot: d376a60a-5070-4afd-b9ea-676089205c6a, volume: 8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[33918715-29eb-40d0-976f-6d51b22e992b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:44 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:44 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:44 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a Jul 31 07:28:44 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Flow 'volume_create_manager' (114c450e-b858-4ac9-8f3a-dfe0dc6e5e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:44 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98212909-ddc3-4299-a5a9-569974b37578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.390s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Deleted volume successfully. Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98212909-ddc3-4299-a5a9-569974b37578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-686831706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe06921-3dbf-440a-8f08-dbac0dfbc0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9ed1a5aac41948818fabe5bd49975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:44Z,use_quota=True,user_id='535395272808470b977706c3719efe70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85e81d5-2257-452b-8d61-c7d9183f5896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85e81d5-2257-452b-8d61-c7d9183f5896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac51be9-d180-40be-91c3-5a0eefe98fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac51be9-d180-40be-91c3-5a0eefe98fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe06921-3dbf-440a-8f08-dbac0dfbc0a5', 'volume_name': 'volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb66e02-f496-4190-8a10-69dcb9492257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb66e02-f496-4190-8a10-69dcb9492257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1982c-0a4c-4cca-8c6a-f187ae88d487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Volume dfe06921-3dbf-440a-8f08-dbac0dfbc0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5', 'volume_size': 1} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-243904f5-3450-4724-b11e-5e4e630d4bb7 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-d2788598-2fb3-4fdf-b359-c95f88d3e39d-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:44 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a" returned: 0 in 0.622s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5764e850-1cde-4d17-9c05-4591285368a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[53111e2b-d6a8-47fa-85cc-b17c225fab98]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:44 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 Jul 31 07:28:44 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:45 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9" returned: 0 in 0.656s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:45 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 Jul 31 07:28:45 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Flow 'volume_create_manager' (7190472c-279c-4078-9604-ec8f32be55ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b069707e-3fd8-463c-a33f-7d847e5d1394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b069707e-3fd8-463c-a33f-7d847e5d1394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-248139297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce39b69-5091-4103-8536-728ab4884098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa31ed1c08f498d8e277805fde3e3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:45Z,use_quota=True,user_id='cda5b2ddaabc443a89dad5d86f154be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac0f4e4-5167-43ae-ab87-a5c5a434a9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac0f4e4-5167-43ae-ab87-a5c5a434a9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a748cb-733f-4441-8007-c0512be045bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a748cb-733f-4441-8007-c0512be045bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce39b69-5091-4103-8536-728ab4884098', 'volume_name': 'volume-4ce39b69-5091-4103-8536-728ab4884098', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b91650e-bc71-4f9a-b071-c52cc9d49e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b91650e-bc71-4f9a-b071-c52cc9d49e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe0aa12-2e62-47f0-a029-537956bdc3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Volume 4ce39b69-5091-4103-8536-728ab4884098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce39b69-5091-4103-8536-728ab4884098', 'volume_size': 1} Jul 31 07:28:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:51 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" returned: 0 in 5.802s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:51 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37fae35-5058-4726-ba70-4c98ccdeaccc]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:51 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 Jul 31 07:28:51 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:51 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9" returned: 0 in 0.512s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:51 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:28:51 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Converted 1024.00 MB image at 176.47 MB/s Jul 31 07:28:51 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:28:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:51 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 Jul 31 07:28:51 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:52 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" returned: 0 in 0.248s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" released by "_copy_volume_from_snapshot" :: held 8.009s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Acquiring lock "cinder-quobyte-d376a60a-5070-4afd-b9ea-676089205c6a" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-d376a60a-5070-4afd-b9ea-676089205c6a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Deleting offline snapshot d376a60a-5070-4afd-b9ea-676089205c6a of volume 5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] snapshot_file for this snap is: volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6025403-c2cf-46b9-adbd-ce67a9f98ad6]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:52 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a Jul 31 07:28:52 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:52 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a" returned: 0 in 0.416s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5764e850-1cde-4d17-9c05-4591285368a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9869ed-8e0b-4d6d-bf3f-d0adcdf31d9c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:52 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 Jul 31 07:28:52 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:52 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9" returned: 0 in 0.359s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:52 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a Jul 31 07:28:52 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:53 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a" returned: 0 in 0.333s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:53 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a Jul 31 07:28:53 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:53 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9.d376a60a-5070-4afd-b9ea-676089205c6a" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-d376a60a-5070-4afd-b9ea-676089205c6a" released by "_delete_snapshot" :: held 1.480s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.662s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.914s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-686831706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe06921-3dbf-440a-8f08-dbac0dfbc0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9ed1a5aac41948818fabe5bd49975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:44Z,use_quota=True,user_id='535395272808470b977706c3719efe70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Creating volume dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:53 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:53 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 1073741824 Jul 31 07:28:53 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4c4cc11e-ee03-4fac-a7c1-61913b5faafc tempest-GroupsV314Test-746816283 None] Create group from source-group-4319d18b-f6ea-4300-8bcf-2c9e80b1cb36 completed successfully. Jul 31 07:28:54 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 1073741824" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:54 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 Jul 31 07:28:54 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:54 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5" returned: 0 in 0.250s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.687s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-248139297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce39b69-5091-4103-8536-728ab4884098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa31ed1c08f498d8e277805fde3e3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:45Z,use_quota=True,user_id='cda5b2ddaabc443a89dad5d86f154be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Creating volume 4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:54 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1982c-0a4c-4cca-8c6a-f187ae88d487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153364a3-a0cf-45f7-9d66-6b2da5c6d6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:54 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 1073741824 Jul 31 07:28:54 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:54 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Volume volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 (dfe06921-3dbf-440a-8f08-dbac0dfbc0a5): created successfully Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153364a3-a0cf-45f7-9d66-6b2da5c6d6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Flow 'volume_create_manager' (114c450e-b858-4ac9-8f3a-dfe0dc6e5e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6001ab4b-8d89-4968-8a8b-d621be8bdf6c tempest-VolumesListAdminTestJSON-195238772 None] Created volume successfully. Jul 31 07:28:54 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 1073741824" returned: 0 in 0.493s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:54 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 Jul 31 07:28:54 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Flow 'volume_create_manager' (30ecdceb-569d-4b2f-9a80-b246c1d17813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc33b9b3-c0c9-48f8-ab5d-b66e3fbffaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc33b9b3-c0c9-48f8-ab5d-b66e3fbffaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-126649187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9ff87a-0636-4205-a5fc-7f8e6a568eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9ed1a5aac41948818fabe5bd49975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:55Z,use_quota=True,user_id='535395272808470b977706c3719efe70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a829f3-0743-49a2-8621-dad2905ef23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a829f3-0743-49a2-8621-dad2905ef23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4255a69e-2a91-408d-afd0-25d07db3f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4255a69e-2a91-408d-afd0-25d07db3f513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc9ff87a-0636-4205-a5fc-7f8e6a568eb3', 'volume_name': 'volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305c51ee-5d72-47b2-827f-507e8e22bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305c51ee-5d72-47b2-827f-507e8e22bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d27085-2997-4130-864c-5cd188f4aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:55 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Volume fc9ff87a-0636-4205-a5fc-7f8e6a568eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3', 'volume_size': 1} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:55 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098" returned: 0 in 0.293s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-126649187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9ff87a-0636-4205-a5fc-7f8e6a568eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9ed1a5aac41948818fabe5bd49975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:55Z,use_quota=True,user_id='535395272808470b977706c3719efe70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Creating volume fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:55 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:55 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 1073741824 Jul 31 07:28:55 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe0aa12-2e62-47f0-a029-537956bdc3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce39b69-5091-4103-8536-728ab4884098', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f03557-4049-4970-9735-116167ca7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Acquiring lock "cinder-quobyte-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:55 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Volume volume-4ce39b69-5091-4103-8536-728ab4884098 (4ce39b69-5091-4103-8536-728ab4884098): created successfully Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f03557-4049-4970-9735-116167ca7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Flow 'volume_create_manager' (7190472c-279c-4078-9604-ec8f32be55ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" acquired by "delete_volume" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8ed86628-39ec-4d50-aea1-59df90612b9b tempest-VolumesExtendTest-1738599844 None] Created volume successfully. Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf8b7c-2a63-4374-9de9-498cf23148bd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:55 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 Jul 31 07:28:55 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:55 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 1073741824" returned: 0 in 0.465s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:55 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" returned: 0 in 0.403s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:55 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 Jul 31 07:28:55 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:55 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7 Jul 31 07:28:55 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:55 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.022s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:56 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d27085-2997-4130-864c-5cd188f4aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d56c10-1ee9-43a1-80b7-be2689866405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Creating offline snapshot af965f86-5f51-4825-9852-a7bfec53fbcd of volume 4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" returned: 0 in 0.307s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0910363b-a7f6-4096-bb31-40a71da69b52]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-8b9f8c44-f0d0-4f57-b08a-9b74f890d9e7" released by "delete_volume" :: held 0.776s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:56 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Volume volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 (fc9ff87a-0636-4205-a5fc-7f8e6a568eb3): created successfully Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d56c10-1ee9-43a1-80b7-be2689866405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Flow 'volume_create_manager' (30ecdceb-569d-4b2f-9a80-b246c1d17813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5e284ceb-e76b-4929-9dc1-701817b76895 tempest-VolumesListAdminTestJSON-195238772 None] Created volume successfully. Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Created reservations ['f596a62a-7003-48b9-be01-67da58d58332'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:56 devstack cinder-volume[88915]: WARNING cinder.quota [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-656205677 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-656205677, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:28:56 devstack cinder-volume[88915]: WARNING cinder.quota [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-656205677 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-656205677, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Created reservations ['873428c9-9e27-48c7-9727-c36dce0b3bdc', '78680753-8b38-4973-806d-9e1941add152', '0aa16610-76af-45a3-90a7-01f6a0dc4e57', '70dcedaf-ea20-4ed4-b7b0-6f18c5ef0801'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:56 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 Jul 31 07:28:56 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:56 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:56 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:56 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098" returned: 0 in 0.412s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:56 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd 1G Jul 31 07:28:56 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:56 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.269s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-07da6914-5889-4c2e-8002-1ad06c70ac71 tempest-GroupsV314Test-746816283 None] Delete group completed successfully. Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Acquiring lock "cinder-quobyte-5764e850-1cde-4d17-9c05-4591285368a9" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-5764e850-1cde-4d17-9c05-4591285368a9" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0bde2-f4fe-4039-9d2f-cf2dadeff27f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:56 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 Jul 31 07:28:56 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:56 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd 1G" returned: 0 in 0.450s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce39b69-5091-4103-8536-728ab4884098 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:56 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce39b69-5091-4103-8536-728ab4884098 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd Jul 31 07:28:56 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:57 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9" returned: 0 in 0.417s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:57 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9 Jul 31 07:28:57 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:57 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce39b69-5091-4103-8536-728ab4884098 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd" returned: 0 in 0.328s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:57 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd is being set with open permissions: ugo+rw Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:57 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd Jul 31 07:28:57 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:57 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5764e850-1cde-4d17-9c05-4591285368a9" returned: 0 in 0.259s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Lock "cinder-quobyte-5764e850-1cde-4d17-9c05-4591285368a9" released by "delete_volume" :: held 0.739s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:28:57 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd" returned: 0 in 0.262s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:57 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.info Jul 31 07:28:57 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Created reservations ['1d7133a0-dda2-453f-a55f-57b6adb8fc9c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Created reservations ['caf1a8f1-7207-4272-afa5-2c1ead52de62', 'e586acc0-fcec-4dad-a460-3c301606753e', '53677af4-dcc5-44b9-bd03-d1d46ce7e6ba', 'adaacca3-602f-4a35-9d17-2560dc62b84b'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Flow 'volume_create_manager' (7c8bf95b-5a37-45cf-b4d0-ac4f24543693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32004497-a6a3-42b7-99bf-a754e908a3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32004497-a6a3-42b7-99bf-a754e908a3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1409209283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fabd8fe-e588-46f2-8b6c-36e8cd58e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9ed1a5aac41948818fabe5bd49975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:58Z,use_quota=True,user_id='535395272808470b977706c3719efe70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681dd1d7-5054-4de3-a8ad-3e689ef6b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681dd1d7-5054-4de3-a8ad-3e689ef6b80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ba06b4-bca0-4b9e-a685-b2ee37af36b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ba06b4-bca0-4b9e-a685-b2ee37af36b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fabd8fe-e588-46f2-8b6c-36e8cd58e017', 'volume_name': 'volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49af64eb-6b9a-497b-9677-55e6bbc53b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49af64eb-6b9a-497b-9677-55e6bbc53b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ed232f-e444-4d5b-9a1e-ffadc3ba9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:57 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Volume 3fabd8fe-e588-46f2-8b6c-36e8cd58e017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017', 'volume_size': 1} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:57 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.info" returned: 0 in 0.313s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:57 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.info is being set with open permissions: ugo+rw Jul 31 07:28:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:57 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:28:57 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:57 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.info Jul 31 07:28:57 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:58 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:28:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d7a43719-cf97-4a00-b4ea-344506bcf343 tempest-GroupsV314Test-746816283 None] Delete group completed successfully. Jul 31 07:28:58 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.info" returned: 0 in 0.286s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.362s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1409209283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fabd8fe-e588-46f2-8b6c-36e8cd58e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9ed1a5aac41948818fabe5bd49975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:28:58Z,use_quota=True,user_id='535395272808470b977706c3719efe70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Creating volume 3fabd8fe-e588-46f2-8b6c-36e8cd58e017 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:28:58 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:58 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 1073741824 Jul 31 07:28:58 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cbaa1f0a-aeaa-4d3c-b422-927f1f0403db tempest-VolumesExtendTest-1738599844 None] Create snapshot completed successfully Jul 31 07:28:58 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 1073741824" returned: 0 in 0.498s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:58 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 Jul 31 07:28:58 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:58 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ed232f-e444-4d5b-9a1e-ffadc3ba9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a49ae54-39fb-48c5-bb20-d4693b9dfcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:28:58 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Volume volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 (3fabd8fe-e588-46f2-8b6c-36e8cd58e017): created successfully Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a49ae54-39fb-48c5-bb20-d4693b9dfcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:28:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Flow 'volume_create_manager' (7c8bf95b-5a37-45cf-b4d0-ac4f24543693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:28:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-20249e38-0507-4d39-be12-f97ecba78af7 tempest-VolumesListAdminTestJSON-195238772 None] Created volume successfully. Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b6503b-5784-4377-87fb-e66e5b896790]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:59 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 Jul 31 07:28:59 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:28:59 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098" returned: 0 in 0.399s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd 2G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd 2G" returned: 0 in 0.176s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:28:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.611s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:28:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e27a701b-1993-4acc-8271-a48616ac2c94 tempest-VolumesExtendTest-1738599844 None] Extend volume completed successfully. Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Acquiring lock "cinder-af965f86-5f51-4825-9852-a7bfec53fbcd-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Lock "cinder-af965f86-5f51-4825-9852-a7bfec53fbcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Acquiring lock "cinder-quobyte-4ce39b69-5091-4103-8536-728ab4884098" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-4ce39b69-5091-4103-8536-728ab4884098" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Acquiring lock "cinder-quobyte-af965f86-5f51-4825-9852-a7bfec53fbcd" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-af965f86-5f51-4825-9852-a7bfec53fbcd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Deleting offline snapshot af965f86-5f51-4825-9852-a7bfec53fbcd of volume 4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] snapshot_file for this snap is: volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5192946-564b-4d46-87ca-289c5d2c3c78]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:00 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd Jul 31 07:29:00 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Flow 'volume_create_manager' (a1795848-64ce-4149-ac88-057329313c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e76183-b2ec-48ca-a6f9-72529e87f177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e76183-b2ec-48ca-a6f9-72529e87f177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1ee911-8e23-4aac-a83e-6fef90becd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e37e98c5698487597a071f5ba479d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:01Z,use_quota=True,user_id='79424aaa21a44b80ba9b8dbbb88e0d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44acb70-b08a-4c1c-81aa-0054b894f966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44acb70-b08a-4c1c-81aa-0054b894f966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d9a393-7e26-4f8d-8e61-d9adffe98d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d9a393-7e26-4f8d-8e61-d9adffe98d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca1ee911-8e23-4aac-a83e-6fef90becd43', 'volume_name': 'volume-ca1ee911-8e23-4aac-a83e-6fef90becd43', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9291fb-90cf-4bab-8700-04218108688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9291fb-90cf-4bab-8700-04218108688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b199ceb-0297-431d-93b3-f9673206feae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:00 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Volume ca1ee911-8e23-4aac-a83e-6fef90becd43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca1ee911-8e23-4aac-a83e-6fef90becd43', 'volume_size': 1} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1ee911-8e23-4aac-a83e-6fef90becd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e37e98c5698487597a071f5ba479d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:01Z,use_quota=True,user_id='79424aaa21a44b80ba9b8dbbb88e0d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Creating volume ca1ee911-8e23-4aac-a83e-6fef90becd43 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:00 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:01 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 1073741824 Jul 31 07:29:01 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:01 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd" returned: 0 in 0.458s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce39b69-5091-4103-8536-728ab4884098(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[640fb94f-5d44-4258-a65d-0470bf806be4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:01 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 Jul 31 07:29:01 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:01 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 1073741824" returned: 0 in 0.488s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:01 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098" returned: 0 in 0.399s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:01 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd Jul 31 07:29:01 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:01 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 Jul 31 07:29:01 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:01 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43" returned: 0 in 0.313s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b199ceb-0297-431d-93b3-f9673206feae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1ee911-8e23-4aac-a83e-6fef90becd43', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187abc7-bba2-4653-8172-f55141371268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:01 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Volume volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 (ca1ee911-8e23-4aac-a83e-6fef90becd43): created successfully Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187abc7-bba2-4653-8172-f55141371268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Flow 'volume_create_manager' (a1795848-64ce-4149-ac88-057329313c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:01 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-985c2f0d-2be7-460a-9e55-80095035d317 tempest-VolumesListAdminTestJSON-323126249 None] Created volume successfully. Jul 31 07:29:02 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd" returned: 0 in 0.544s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:02 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd Jul 31 07:29:02 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:02 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098.af965f86-5f51-4825-9852-a7bfec53fbcd" returned: 0 in 0.280s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-af965f86-5f51-4825-9852-a7bfec53fbcd" released by "_delete_snapshot" :: held 1.808s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-4ce39b69-5091-4103-8536-728ab4884098" released by "delete_snapshot" :: held 1.833s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Created reservations ['c9223659-7b1a-4413-88ee-351c69d13eb8', '4e6d0f1a-5b28-410a-854f-ec434404f594', 'c320af46-5c88-4d2a-8e47-28a6ae4b9bfc', 'c49ec843-1719-49cd-86ab-fedf63b4bbe6'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Delete snapshot completed successfully. Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-096da132-cb62-46cc-968f-5cc33739a14d tempest-VolumesExtendTest-1738599844 None] Lock "cinder-af965f86-5f51-4825-9852-a7bfec53fbcd-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "cinder-4ce39b69-5091-4103-8536-728ab4884098-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-4ce39b69-5091-4103-8536-728ab4884098-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "cinder-quobyte-4ce39b69-5091-4103-8536-728ab4884098" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-4ce39b69-5091-4103-8536-728ab4884098" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1b91f3-5e61-4608-ae49-df7601d43fa3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:03 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 Jul 31 07:29:03 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Acquiring lock "cinder-ca1ee911-8e23-4aac-a83e-6fef90becd43-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Lock "cinder-ca1ee911-8e23-4aac-a83e-6fef90becd43-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Acquiring lock "cinder-quobyte-ca1ee911-8e23-4aac-a83e-6fef90becd43" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Lock "cinder-quobyte-ca1ee911-8e23-4aac-a83e-6fef90becd43" acquired by "delete_volume" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e4554b-b377-4afd-be61-ce430791288e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "cinder-3fabd8fe-e588-46f2-8b6c-36e8cd58e017-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-3fabd8fe-e588-46f2-8b6c-36e8cd58e017-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "cinder-quobyte-3fabd8fe-e588-46f2-8b6c-36e8cd58e017" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:03 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098" returned: 0 in 0.576s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-quobyte-3fabd8fe-e588-46f2-8b6c-36e8cd58e017" acquired by "delete_volume" :: waited 0.048s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:03 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 Jul 31 07:29:03 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:03 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098 Jul 31 07:29:03 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c1b862-6e88-4f53-848c-e34902b5ad84]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:03 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 Jul 31 07:29:03 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:03 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4ce39b69-5091-4103-8536-728ab4884098" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-quobyte-4ce39b69-5091-4103-8536-728ab4884098" released by "delete_volume" :: held 0.989s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:03 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43" returned: 0 in 0.583s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:03 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43 Jul 31 07:29:03 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:03 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Created reservations ['c9b843fb-d0eb-4a52-b40b-af22afb29ce2', 'f3121ea9-6897-4449-b94d-9b3a14360cab', '961e01e5-dd02-4a8b-9a3a-8616d4dd1ef6', '51a0ffef-21e8-4414-ae3b-e1cb92d1e74c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:04 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017" returned: 0 in 0.500s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:04 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:04 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:04 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017 Jul 31 07:29:04 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:04 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca1ee911-8e23-4aac-a83e-6fef90becd43" returned: 0 in 0.338s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Lock "cinder-quobyte-ca1ee911-8e23-4aac-a83e-6fef90becd43" released by "delete_volume" :: held 1.008s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Created reservations ['1fc172ef-c9fa-4031-8152-cf445b51bcc8', '5fae71ae-25c6-4bca-b27d-180f90bd085a', '7157810e-b3fd-449e-8242-ba51554dfcfe', '425bd80b-26d1-42dd-bedf-db61a6bc78bd'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:04 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.298s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Deleted volume successfully. Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-283228ef-f9e6-4e09-8542-fb2ae4d039f9 tempest-VolumesExtendTest-1738599844 None] Lock "cinder-4ce39b69-5091-4103-8536-728ab4884098-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:04 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3fabd8fe-e588-46f2-8b6c-36e8cd58e017" returned: 0 in 0.379s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:04 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:04 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-quobyte-3fabd8fe-e588-46f2-8b6c-36e8cd58e017" released by "delete_volume" :: held 0.978s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Flow 'volume_create_manager' (959f5ef4-0ab3-4abd-a5c2-c25773dfe89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc58c9f-d923-462d-8bdf-ba40329cdc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc58c9f-d923-462d-8bdf-ba40329cdc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-228343318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c960de857eca48d2990722df2a7d6dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:04Z,use_quota=True,user_id='3b6da3a73d944e42be4639db63194bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7064880f-d5fb-4e4c-a345-3ec9cb09eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7064880f-d5fb-4e4c-a345-3ec9cb09eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8e5d0b-930e-431c-bd08-b463a39ce98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8e5d0b-930e-431c-bd08-b463a39ce98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d', 'volume_name': 'volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe8e26b-e344-4ff4-97d9-2667ca8e3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe8e26b-e344-4ff4-97d9-2667ca8e3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27dd691-4d17-459b-b997-ea8407559737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:04 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Volume 2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d', 'volume_size': 1} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-228343318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c960de857eca48d2990722df2a7d6dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:04Z,use_quota=True,user_id='3b6da3a73d944e42be4639db63194bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Creating volume 2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:04 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:04 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d 1073741824 Jul 31 07:29:04 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Created reservations ['9cb82b3f-946b-4bb0-a86c-789128e87ac6', 'd06ae576-124b-4d7d-b0db-cd97ccbd6543', '94190fae-76c8-4506-aeaf-2fd2617bdcd2', '825f0a2a-3123-4ef5-bae9-146a93c656f2'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:04 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.267s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Deleted volume successfully. Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d6b59fb8-b5a0-4de1-ad2f-fb8f35e79829 tempest-VolumesListAdminTestJSON-323126249 None] Lock "cinder-ca1ee911-8e23-4aac-a83e-6fef90becd43-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:04 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:04 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:04 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.260s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:04 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Deleted volume successfully. Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0421db86-8fab-45ae-bb22-e919f6ce7961 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-3fabd8fe-e588-46f2-8b6c-36e8cd58e017-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:05 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d 1073741824" returned: 0 in 0.496s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:05 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d Jul 31 07:29:05 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:05 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d" returned: 0 in 0.276s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27dd691-4d17-459b-b997-ea8407559737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf59a11f-cecc-4431-bbcc-77de2bfaf3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Volume volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d (2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d): created successfully Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf59a11f-cecc-4431-bbcc-77de2bfaf3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Flow 'volume_create_manager' (959f5ef4-0ab3-4abd-a5c2-c25773dfe89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0c168ada-8ace-4c49-a715-e3db8ead08c6 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Created volume successfully. Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "cinder-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Flow 'volume_create_manager' (f14e6af1-79a4-4883-b176-b80e5863f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23cc117-3d20-49bc-883e-8ec6544a4804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23cc117-3d20-49bc-883e-8ec6544a4804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-423659747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009bdefe-3e39-4b9a-9bce-2656ab816216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4c295fdac4749ab628c9aac64e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:06Z,use_quota=True,user_id='7d190d7ba3324db593887cb068d445fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475e55db-4caa-4b8e-a496-0b550735f20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475e55db-4caa-4b8e-a496-0b550735f20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c80fab-316c-4e3e-b659-7b38fe0f9bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c80fab-316c-4e3e-b659-7b38fe0f9bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009bdefe-3e39-4b9a-9bce-2656ab816216', 'volume_name': 'volume-009bdefe-3e39-4b9a-9bce-2656ab816216', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d81c21b-6404-4b06-a195-c626448d179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d81c21b-6404-4b06-a195-c626448d179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b9f3d6-af57-48c5-a14c-a3e471a50f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Volume 009bdefe-3e39-4b9a-9bce-2656ab816216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009bdefe-3e39-4b9a-9bce-2656ab816216', 'volume_size': 1} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-423659747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009bdefe-3e39-4b9a-9bce-2656ab816216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a4c295fdac4749ab628c9aac64e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:06Z,use_quota=True,user_id='7d190d7ba3324db593887cb068d445fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Creating volume 009bdefe-3e39-4b9a-9bce-2656ab816216 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:05 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "cinder-quobyte-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:05 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 1073741824 Jul 31 07:29:05 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-quobyte-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e325a94-3991-4ac2-9053-a5c27736731c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:06 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 Jul 31 07:29:06 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:06 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 1073741824" returned: 0 in 0.505s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:06 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3" returned: 0 in 0.450s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:06 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 Jul 31 07:29:06 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:06 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3 Jul 31 07:29:06 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:06 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-quobyte-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3" released by "delete_volume" :: held 0.858s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:06 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216" returned: 0 in 0.427s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b9f3d6-af57-48c5-a14c-a3e471a50f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009bdefe-3e39-4b9a-9bce-2656ab816216', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10093618-812f-4ed8-81d5-45120a31238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Created reservations ['06ddc1eb-1813-430a-86a2-7d32b9cc74a7', '9c51e9ac-1e3b-49a2-8ba6-eca6477b163b', 'afc18aca-866b-4109-bead-b050d249394a', '31b374b8-149f-4756-879e-c008ef37027f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:06 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Volume volume-009bdefe-3e39-4b9a-9bce-2656ab816216 (009bdefe-3e39-4b9a-9bce-2656ab816216): created successfully Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10093618-812f-4ed8-81d5-45120a31238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Flow 'volume_create_manager' (f14e6af1-79a4-4883-b176-b80e5863f242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8505fd58-29ef-4f0e-b25b-06285cbe8e21 tempest-AttachVolumeNegativeTest-1195133799 None] Created volume successfully. Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:06 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:06 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:07 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.280s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:07 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Deleted volume successfully. Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-42d3e1c4-679d-47cd-bd3d-aea2884a8664 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-fc9ff87a-0636-4205-a5fc-7f8e6a568eb3-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Acquiring lock "cinder-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "cinder-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Acquiring lock "cinder-quobyte-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "cinder-quobyte-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3136fa5a-6c14-470c-b6c5-6ed5d98f18a2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:07 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d Jul 31 07:29:07 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "cinder-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "cinder-quobyte-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-quobyte-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6686e4b5-43b6-4084-9a02-cafefd570b43]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:08 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d" returned: 0 in 0.447s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:08 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d Jul 31 07:29:08 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:08 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 Jul 31 07:29:08 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Flow 'volume_create_manager' (222c2e4a-d23a-4c6e-8225-d3864d8efa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4347de-74b4-4d07-b6fd-b44fb1df28ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4347de-74b4-4d07-b6fd-b44fb1df28ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-606176008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24402f66-8cc0-464c-9886-da0ff274d66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ffc878f726448689a4f2245eb3a8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:08Z,use_quota=True,user_id='5158fbd216d74eca88f7afe889c85a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c4a605-6193-47a3-8253-bf6ed44dc999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c4a605-6193-47a3-8253-bf6ed44dc999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58007491-60ba-4ef5-b578-49bc4a87f212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58007491-60ba-4ef5-b578-49bc4a87f212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24402f66-8cc0-464c-9886-da0ff274d66a', 'volume_name': 'volume-24402f66-8cc0-464c-9886-da0ff274d66a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa5c1ff-029e-466e-8e9a-fa36be60234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa5c1ff-029e-466e-8e9a-fa36be60234b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c915d7e1-16b7-469a-abc0-4a7573c06a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:08 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Volume 24402f66-8cc0-464c-9886-da0ff274d66a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24402f66-8cc0-464c-9886-da0ff274d66a', 'volume_size': 1} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-606176008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24402f66-8cc0-464c-9886-da0ff274d66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ffc878f726448689a4f2245eb3a8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:08Z,use_quota=True,user_id='5158fbd216d74eca88f7afe889c85a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Creating volume 24402f66-8cc0-464c-9886-da0ff274d66a {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:08 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:08 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d" returned: 0 in 0.367s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:08 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a 1073741824 Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "cinder-quobyte-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d" released by "delete_volume" :: held 0.893s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:08 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Created reservations ['3699baeb-16a1-4fe8-8f30-a0fd4f895e73', '25fbbf58-e09e-418e-bf97-715d92b26c6a', '994fcd1c-792e-4908-9ff4-44a8296b3cae', 'e3711e9c-ef59-4de5-99fb-c544dd282fb3'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-edd34fec-196f-450c-88bb-02078d25535a req-5bc076e9-32fa-4156-9c83-0eb6dc192efb tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:08 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:08 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:08 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5" returned: 0 in 0.673s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:08 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5 Jul 31 07:29:08 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:09 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.302s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Deleted volume successfully. Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1d146458-3910-4944-8224-848384e3ceb8 tempest-VolumeQuotasNegativeTestJSON-380433755 None] Lock "cinder-2c2c3bf4-46bb-4ee1-84c9-0a50a9d9324d-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:09 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a 1073741824" returned: 0 in 0.583s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:09 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5" returned: 0 in 0.317s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-quobyte-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5" released by "delete_volume" :: held 1.039s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:09 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a Jul 31 07:29:09 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Created reservations ['04616ea9-b1ef-411d-9c59-f18a47d0ea4d', 'ac0f2adc-a80d-429f-82a0-fe605810cc7f', '41f82d05-7506-41cb-871a-38dd060cd4b8', 'ef0a26e8-7ae8-4639-83d3-51d918fd051f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:09 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:09 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:09 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a" returned: 0 in 0.297s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-edd34fec-196f-450c-88bb-02078d25535a req-5bc076e9-32fa-4156-9c83-0eb6dc192efb tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.773s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-edd34fec-196f-450c-88bb-02078d25535a req-5bc076e9-32fa-4156-9c83-0eb6dc192efb tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c915d7e1-16b7-469a-abc0-4a7573c06a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24402f66-8cc0-464c-9886-da0ff274d66a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33210afa-7cb2-4226-8c06-b9225044d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Volume volume-24402f66-8cc0-464c-9886-da0ff274d66a (24402f66-8cc0-464c-9886-da0ff274d66a): created successfully Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33210afa-7cb2-4226-8c06-b9225044d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Flow 'volume_create_manager' (222c2e4a-d23a-4c6e-8225-d3864d8efa91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ecd5cc63-5674-4eca-be93-9e5a024c6bd9 tempest-VolumesNegativeTest-197922553 None] Created volume successfully. Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-edd34fec-196f-450c-88bb-02078d25535a req-5bc076e9-32fa-4156-9c83-0eb6dc192efb tempest-AttachVolumeNegativeTest-1195133799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-009bdefe-3e39-4b9a-9bce-2656ab816216', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9dc164b-a85e-44e7-b84e-dbe587424096', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:29:09 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.321s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Deleted volume successfully. Jul 31 07:29:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-edd34fec-196f-450c-88bb-02078d25535a req-5bc076e9-32fa-4156-9c83-0eb6dc192efb tempest-AttachVolumeNegativeTest-1195133799 None] attachment_update completed successfully. Jul 31 07:29:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dc128f97-de11-49a9-8fdc-dfc288cf5331 tempest-VolumesListAdminTestJSON-195238772 None] Lock "cinder-dfe06921-3dbf-440a-8f08-dbac0dfbc0a5-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-25bb6589-86c9-4e28-8457-3863e96e9b6e req-ac7aea6e-1c15-4a29-9e04-b64a2c77850c tempest-AttachVolumeNegativeTest-1195133799 None] Terminate volume connection completed successfully. Jul 31 07:29:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-25bb6589-86c9-4e28-8457-3863e96e9b6e req-ac7aea6e-1c15-4a29-9e04-b64a2c77850c tempest-AttachVolumeNegativeTest-1195133799 None] Deleting attachment e9dc164b-a85e-44e7-b84e-dbe587424096. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Flow 'volume_create_manager' (c7fda30a-0515-460b-af2b-ceaa97768d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bdbb1a-53ca-461e-ba19-1934b61ca559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bdbb1a-53ca-461e-ba19-1934b61ca559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2062432946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dd656d4f1745ee9e459269b333044f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:18Z,use_quota=True,user_id='ec333f906c0446ec9cc4b93b99a16dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f5a890-e332-4404-a130-528324f0b3aa),volume_type_id=52f5a890-e332-4404-a130-528324f0b3aa)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d755df26-efd3-45cf-9d9b-37a393575a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d755df26-efd3-45cf-9d9b-37a393575a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280dc58e-0023-48ee-860c-5b8ad22673ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280dc58e-0023-48ee-860c-5b8ad22673ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a', 'volume_name': 'volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0235c14a-c64a-49c6-8884-55e1950ac802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0235c14a-c64a-49c6-8884-55e1950ac802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13cf5f1-9f50-4f81-b548-a317e87a6e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:17 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Volume ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a', 'volume_size': 1} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2062432946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dd656d4f1745ee9e459269b333044f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:18Z,use_quota=True,user_id='ec333f906c0446ec9cc4b93b99a16dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f5a890-e332-4404-a130-528324f0b3aa),volume_type_id=52f5a890-e332-4404-a130-528324f0b3aa)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Creating volume ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:17 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:17 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a 1073741824 Jul 31 07:29:17 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:18 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a 1073741824" returned: 0 in 0.541s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:18 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a Jul 31 07:29:18 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:18 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a" returned: 0 in 0.390s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13cf5f1-9f50-4f81-b548-a317e87a6e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6108c0bd-f22e-4174-9065-706445248dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Volume volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a (ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a): created successfully Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6108c0bd-f22e-4174-9065-706445248dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Flow 'volume_create_manager' (c7fda30a-0515-460b-af2b-ceaa97768d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7be7fa5f-d4cc-47d1-9e62-616950d0c5f6 tempest-VolumeTypesAccessTest-1675143664 None] Created volume successfully. Jul 31 07:29:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "cinder-009bdefe-3e39-4b9a-9bce-2656ab816216-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-009bdefe-3e39-4b9a-9bce-2656ab816216-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "cinder-quobyte-009bdefe-3e39-4b9a-9bce-2656ab816216" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-quobyte-009bdefe-3e39-4b9a-9bce-2656ab816216" acquired by "delete_volume" :: waited 0.047s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965ff9d-0c9b-4f34-a3f5-3852b4b77ad0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:19 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 Jul 31 07:29:19 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Acquiring lock "cinder-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Lock "cinder-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Acquiring lock "cinder-quobyte-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Lock "cinder-quobyte-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e397c475-f2c6-4252-9475-f66b32db3a4d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:20 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216" returned: 0 in 0.897s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:20 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a Jul 31 07:29:20 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:20 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216 Jul 31 07:29:20 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:20 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a" returned: 0 in 0.531s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:20 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-009bdefe-3e39-4b9a-9bce-2656ab816216" returned: 0 in 0.359s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-quobyte-009bdefe-3e39-4b9a-9bce-2656ab816216" released by "delete_volume" :: held 1.358s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:20 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a Jul 31 07:29:20 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Created reservations ['7ac66e9c-224e-4e40-b4f8-db0e9c866051', '9faccfb4-abc0-44c3-8e23-55e5c6bec4ad', '4ead9c13-4b9d-4c8e-a021-a624976c9aee', '114e02ce-00f5-4cbf-90d3-2cbb9a92c29a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:20 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:20 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:21 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Lock "cinder-quobyte-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a" released by "delete_volume" :: held 0.987s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:21 devstack cinder-volume[88915]: WARNING cinder.quota [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1039992269 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1039992269, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:29:21 devstack cinder-volume[88915]: WARNING cinder.quota [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1039992269 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1039992269, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Created reservations ['3cbe5149-4c76-43e0-b517-2d69919c1bd6', '35e6bd08-b9fd-4d7f-873b-21cc891fba4e', '4a0747df-16a8-42e1-89e9-a4f33e8386cd', 'fb4a45ee-28ab-4b00-9d1a-9b23390e91cd'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:21 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.489s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Deleted volume successfully. Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-06db2c84-a0ac-4f92-87b6-5b5577d5b723 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-009bdefe-3e39-4b9a-9bce-2656ab816216-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:21 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:21 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Flow 'volume_create_manager' (28f7e7e8-ff90-4030-952e-61d3b1328883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11565243-1877-44fc-b3c4-a86dab26a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11565243-1877-44fc-b3c4-a86dab26a138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-748504703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6919cc4b-9406-42fd-acff-6496353cc763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9ec0105efa492d9fae1879898d710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:22Z,use_quota=True,user_id='1de21b0637d44eba97dec80c656a2c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb55611-e47d-4a03-8619-2331477dd6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb55611-e47d-4a03-8619-2331477dd6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3760934-92fb-44b4-bfec-3cd7f00a0f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3760934-92fb-44b4-bfec-3cd7f00a0f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6919cc4b-9406-42fd-acff-6496353cc763', 'volume_name': 'volume-6919cc4b-9406-42fd-acff-6496353cc763', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be15937-d75f-4029-acca-17214b31c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be15937-d75f-4029-acca-17214b31c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206a4d3c-b361-4d04-a182-77aca901133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:21 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Volume 6919cc4b-9406-42fd-acff-6496353cc763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6919cc4b-9406-42fd-acff-6496353cc763', 'volume_size': 1} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-748504703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6919cc4b-9406-42fd-acff-6496353cc763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9ec0105efa492d9fae1879898d710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:22Z,use_quota=True,user_id='1de21b0637d44eba97dec80c656a2c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Creating volume 6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:21 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "cinder-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:21 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 1073741824 Jul 31 07:29:21 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:21 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.339s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Deleted volume successfully. Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea9d280-3757-4021-b3a8-e86d955c1e3d tempest-VolumeTypesAccessTest-1675143664 None] Lock "cinder-ccb9b346-2f63-4bbd-b492-f7ab2e16ca6a-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "cinder-quobyte-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-quobyte-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260763d-bf77-4b5e-b711-555279f57307]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:22 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 Jul 31 07:29:22 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:22 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 1073741824" returned: 0 in 0.666s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:22 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 Jul 31 07:29:22 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:22 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8" returned: 0 in 0.678s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:22 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8 Jul 31 07:29:22 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:23 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763" returned: 0 in 0.632s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206a4d3c-b361-4d04-a182-77aca901133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6919cc4b-9406-42fd-acff-6496353cc763', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d9568e-0fe7-4021-a05e-43c3d08e7537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:23 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Volume volume-6919cc4b-9406-42fd-acff-6496353cc763 (6919cc4b-9406-42fd-acff-6496353cc763): created successfully Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d9568e-0fe7-4021-a05e-43c3d08e7537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Flow 'volume_create_manager' (28f7e7e8-ff90-4030-952e-61d3b1328883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cbba3316-9766-4f35-b5b8-e54b81fa08ad tempest-VolumesDeleteCascade-2024135710 None] Created volume successfully. Jul 31 07:29:23 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8" returned: 0 in 0.679s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-quobyte-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8" released by "delete_volume" :: held 1.459s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Created reservations ['5d5fbf6f-f145-494d-94a0-cf0e52c029e7', '61640d7b-0f7c-49d5-b6ca-4705c1fcc8ac', '694c8838-6613-4783-8a73-55c4a73c5533', 'c7e20ce9-8071-473a-9f35-db5dffb2ff52'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:23 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:23 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Creating offline snapshot b1f76f56-816c-4588-9679-c5aca8731078 of volume 6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd74fb6-5ff8-4586-976e-4d4931747653]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:24 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Deleted volume successfully. Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1c5f972c-9798-45c2-aab7-d60854619954 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-5f0aaff7-c6a2-46e1-9e54-040dbc1a85d8-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:24 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 Jul 31 07:29:24 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "cinder-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "cinder-quobyte-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-quobyte-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea201515-3b80-475f-a7df-3879f1e53324]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:24 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763" returned: 0 in 0.660s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:24 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 1G Jul 31 07:29:24 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:24 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb Jul 31 07:29:24 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:25 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb" returned: 0 in 0.432s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:25 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb Jul 31 07:29:25 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:25 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 1G" returned: 0 in 0.637s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6919cc4b-9406-42fd-acff-6496353cc763 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:25 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6919cc4b-9406-42fd-acff-6496353cc763 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 Jul 31 07:29:25 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:25 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb" returned: 0 in 0.354s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-quobyte-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb" released by "delete_volume" :: held 0.867s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Created reservations ['adf82ba0-7955-4a61-929b-5a9eb142f707', '920d9966-2982-4662-a9e5-00bf74ae8a50', 'dd257290-7e73-4ec9-8701-65e9a8890f1d', '8a3e73e2-5451-4955-8963-af6b9b879319'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:25 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:25 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:25 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6919cc4b-9406-42fd-acff-6496353cc763 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078" returned: 0 in 0.612s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:25 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 is being set with open permissions: ugo+rw Jul 31 07:29:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:25 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 Jul 31 07:29:25 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:26 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.433s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:26 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:26 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Deleted volume successfully. Jul 31 07:29:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39449616-7773-4ec1-874e-20fc1a50b171 tempest-AttachVolumeNegativeTest-1195133799 None] Lock "cinder-67246a1b-b4a9-4664-86f8-8f1a0f1db4eb-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:26 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078" returned: 0 in 0.341s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:26 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.info Jul 31 07:29:26 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:26 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.info" returned: 0 in 0.410s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:26 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.info is being set with open permissions: ugo+rw Jul 31 07:29:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:26 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.info Jul 31 07:29:26 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:27 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.info" returned: 0 in 0.301s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-514697eb-ccc4-4e96-a2f8-a5910defbb4f tempest-VolumesDeleteCascade-2024135710 None] Create snapshot completed successfully Jul 31 07:29:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Creating offline snapshot a983b0ae-515b-44e3-a2d8-f0e4f8593aea of volume 6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:29:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[544f1909-4911-4286-95c7-6010485dde5e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:28 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 Jul 31 07:29:28 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:29 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078" returned: 0 in 0.545s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6919cc4b-9406-42fd-acff-6496353cc763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:29 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea 1G Jul 31 07:29:29 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:29 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea 1G" returned: 0 in 0.750s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:29 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea Jul 31 07:29:29 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:30 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:30 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea is being set with open permissions: ugo+rw Jul 31 07:29:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:30 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea Jul 31 07:29:30 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:30 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a15d0aef-7a97-4a56-a179-357bda75200a tempest-VolumesDeleteCascade-2024135710 None] Create snapshot completed successfully Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-6919cc4b-9406-42fd-acff-6496353cc763-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-6919cc4b-9406-42fd-acff-6496353cc763-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Performing cascade delete. {{(pid=88915) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-a983b0ae-515b-44e3-a2d8-f0e4f8593aea-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-a983b0ae-515b-44e3-a2d8-f0e4f8593aea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-a983b0ae-515b-44e3-a2d8-f0e4f8593aea" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-a983b0ae-515b-44e3-a2d8-f0e4f8593aea" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Deleting offline snapshot a983b0ae-515b-44e3-a2d8-f0e4f8593aea of volume 6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] snapshot_file for this snap is: volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfda589-5200-4485-bfa6-43a13b898280]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:32 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea Jul 31 07:29:32 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:32 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea" returned: 0 in 0.517s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6919cc4b-9406-42fd-acff-6496353cc763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ad9ec6-5da3-4175-9738-3ac5abb927b8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:32 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 Jul 31 07:29:32 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:32 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078" returned: 0 in 0.412s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6919cc4b-9406-42fd-acff-6496353cc763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:32 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea Jul 31 07:29:32 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:33 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea" returned: 0 in 0.425s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:33 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea Jul 31 07:29:33 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:33 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:33 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:33 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.a983b0ae-515b-44e3-a2d8-f0e4f8593aea" returned: 0 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-a983b0ae-515b-44e3-a2d8-f0e4f8593aea" released by "_delete_snapshot" :: held 1.878s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" released by "delete_snapshot" :: held 1.920s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Created reservations ['de4dd963-0ff1-4643-b767-52fa161be1bf', '07b302a9-3bc0-45c7-a685-1eaed77cec07', 'e32d15fe-efc1-4ce2-93b7-2c7449803038', '53ebaa4d-7ad3-4784-854f-57e08186ee23'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Delete snapshot completed successfully. Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-a983b0ae-515b-44e3-a2d8-f0e4f8593aea-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-b1f76f56-816c-4588-9679-c5aca8731078-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-b1f76f56-816c-4588-9679-c5aca8731078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-b1f76f56-816c-4588-9679-c5aca8731078" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:34 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.478s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-b1f76f56-816c-4588-9679-c5aca8731078" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Deleting offline snapshot b1f76f56-816c-4588-9679-c5aca8731078 of volume 6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] snapshot_file for this snap is: volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88fa00a-525a-41d7-9496-b119ea7e7ea4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:34 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 Jul 31 07:29:34 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6ef4c550-a309-488c-bcb2-a7ec42a2a5bc tempest-BackendsCapabilitiesAdminTestsJSON-1366482913 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540397644043, 'free_capacity_gb': 1775.7540397644043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88915) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-81756bab-e643-4360-a3bd-e20e6882a206 tempest-BackendsCapabilitiesAdminTestsJSON-1366482913 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540397644043, 'free_capacity_gb': 1775.7540397644043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88915) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 07:29:34 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078" returned: 0 in 0.612s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6919cc4b-9406-42fd-acff-6496353cc763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c388c387-5661-4d7a-99be-01dd9055924f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:35 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 Jul 31 07:29:35 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:35 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763" returned: 0 in 0.522s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:35 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 Jul 31 07:29:35 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Acquiring lock "cinder-24402f66-8cc0-464c-9886-da0ff274d66a-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Lock "cinder-24402f66-8cc0-464c-9886-da0ff274d66a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=145,cinder:UPDATE=180,cinder:DELETE=11,cinder:INSERT=45 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Acquiring lock "cinder-quobyte-24402f66-8cc0-464c-9886-da0ff274d66a" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Lock "cinder-quobyte-24402f66-8cc0-464c-9886-da0ff274d66a" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[805e64fa-0bc9-4b34-be01-c3e0a18c4ebf]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:35 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a Jul 31 07:29:35 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:35 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078" returned: 0 in 0.476s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:35 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078 Jul 31 07:29:35 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:36 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763.b1f76f56-816c-4588-9679-c5aca8731078" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-b1f76f56-816c-4588-9679-c5aca8731078" released by "_delete_snapshot" :: held 2.104s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:36 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a" returned: 0 in 0.536s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" released by "delete_snapshot" :: held 2.146s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:36 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a Jul 31 07:29:36 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Created reservations ['3dab76fa-4010-4ec0-8893-6d774e2a4a68', '7c906102-d20f-4b86-9dfe-1114005ee730', '4b2e8260-1010-448b-8f22-575d257fb315', '04cb067b-4c74-4272-909b-b3e5050db320'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Delete snapshot completed successfully. Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-b1f76f56-816c-4588-9679-c5aca8731078-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Snapshots deleted, issuing volume delete {{(pid=88915) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7247024a-2df9-4582-b0d4-a0aab4752ab5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:36 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-24402f66-8cc0-464c-9886-da0ff274d66a" returned: 0 in 0.315s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Lock "cinder-quobyte-24402f66-8cc0-464c-9886-da0ff274d66a" released by "delete_volume" :: held 0.920s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Created reservations ['6582b3e4-62e3-44ca-9f60-43c34c961dfd', 'e75103b8-65fa-4c19-93c1-608b2ee68f23', '6a3ef099-07ec-4b17-8873-a3648335ebb2', '97acde1a-58bf-4b03-b259-35006e2e725f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:36 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 Jul 31 07:29:36 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:36 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:36 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:37 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763" returned: 0 in 0.517s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:37 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763 Jul 31 07:29:37 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:37 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.298s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Deleted volume successfully. Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c1dce38-6466-48b4-8c91-948101354c9f tempest-VolumesNegativeTest-197922553 None] Lock "cinder-24402f66-8cc0-464c-9886-da0ff274d66a-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:37 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6919cc4b-9406-42fd-acff-6496353cc763" returned: 0 in 0.327s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-6919cc4b-9406-42fd-acff-6496353cc763" released by "delete_volume" :: held 0.916s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Created reservations ['ab819029-797c-49c2-a149-434417e7042f', '6b0f2fe7-3d6e-49d4-a794-db20e9a7e210', '2c47d9e1-4d63-4fdf-b772-35b736718204', '205a0bd7-c7f6-4a17-9588-0d6749e37cd7'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:37 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:37 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:37 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.289s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Deleted volume successfully. Jul 31 07:29:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-312812b5-bf4b-453f-8384-1c6cc6819c07 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-6919cc4b-9406-42fd-acff-6496353cc763-delete_volume" released by "delete_volume" :: held 6.146s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=143,cinder:INSERT=43,cinder:UPDATE=177,cinder:DELETE=16 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Flow 'volume_create_manager' (5d96c537-b434-4772-9d28-14e64198147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3519074e-31e3-4bab-88e9-90f0af94b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3519074e-31e3-4bab-88e9-90f0af94b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2074357608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fe4617-0495-48e0-b3fe-8cb06de1129c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9ec0105efa492d9fae1879898d710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:39Z,use_quota=True,user_id='1de21b0637d44eba97dec80c656a2c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677e8c42-4150-4c60-8333-6a1d4f2711d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677e8c42-4150-4c60-8333-6a1d4f2711d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9113451e-b787-4636-8447-f59da86e578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9113451e-b787-4636-8447-f59da86e578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37fe4617-0495-48e0-b3fe-8cb06de1129c', 'volume_name': 'volume-37fe4617-0495-48e0-b3fe-8cb06de1129c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bfc50a-903b-40e3-a29c-ad822bcbf7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bfc50a-903b-40e3-a29c-ad822bcbf7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32224ed-b019-4dc2-a46f-ede50070e24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:39 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Volume 37fe4617-0495-48e0-b3fe-8cb06de1129c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37fe4617-0495-48e0-b3fe-8cb06de1129c', 'volume_size': 1} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2074357608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fe4617-0495-48e0-b3fe-8cb06de1129c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9ec0105efa492d9fae1879898d710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:39Z,use_quota=True,user_id='1de21b0637d44eba97dec80c656a2c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Creating volume 37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:39 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:39 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c 1073741824 Jul 31 07:29:39 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:39 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c 1073741824" returned: 0 in 0.524s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:39 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c Jul 31 07:29:39 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:40 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32224ed-b019-4dc2-a46f-ede50070e24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37fe4617-0495-48e0-b3fe-8cb06de1129c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f86334-6fd9-4860-aa57-b4b1f674bede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:40 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Volume volume-37fe4617-0495-48e0-b3fe-8cb06de1129c (37fe4617-0495-48e0-b3fe-8cb06de1129c): created successfully Jul 31 07:29:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f86334-6fd9-4860-aa57-b4b1f674bede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Flow 'volume_create_manager' (5d96c537-b434-4772-9d28-14e64198147a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:40 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-782573e9-5c26-4139-a470-74bad75c59b1 tempest-VolumesDeleteCascade-2024135710 None] Created volume successfully. Jul 31 07:29:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Creating offline snapshot ad722c4f-916a-430f-8a18-e96c34bc4326 of volume 37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:29:41 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e425c26f-522d-45d3-8a33-eb0614038757]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:41 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c Jul 31 07:29:41 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5909f05a-7826-4d4b-b383-04a9d43ede29 tempest-GroupSnapshotsTest-1145442677 None] Group tempest-GroupSnapshotsTest-Group-204941200: creating Jul 31 07:29:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5909f05a-7826-4d4b-b383-04a9d43ede29 tempest-GroupSnapshotsTest-1145442677 None] Group tempest-GroupSnapshotsTest-Group-204941200: created successfully Jul 31 07:29:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5909f05a-7826-4d4b-b383-04a9d43ede29 tempest-GroupSnapshotsTest-1145442677 None] Create group completed successfully. Jul 31 07:29:42 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c" returned: 0 in 0.630s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:42 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 1G Jul 31 07:29:42 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:42 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 1G" returned: 0 in 0.519s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37fe4617-0495-48e0-b3fe-8cb06de1129c -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:42 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37fe4617-0495-48e0-b3fe-8cb06de1129c -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 Jul 31 07:29:42 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:43 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37fe4617-0495-48e0-b3fe-8cb06de1129c -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326" returned: 0 in 0.405s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:43 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 is being set with open permissions: ugo+rw Jul 31 07:29:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:43 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 Jul 31 07:29:43 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:43 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326" returned: 0 in 0.287s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:43 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.info Jul 31 07:29:43 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:43 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (c7b888e4-818d-40a1-bc8e-0308a1cf4c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:43 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dcec6f-1bfb-42cc-b668-3c6d8217baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.info" returned: 0 in 0.490s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:44 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.info is being set with open permissions: ugo+rw Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dcec6f-1bfb-42cc-b668-3c6d8217baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258411731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c8584df-5710-4a83-b0e7-3963e0d13a94,host='devstack@QuobyteHD#QuobyteHD',id=556a0383-e9fc-49b4-98bf-6838f5d1006e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:44Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78355e35-bc27-4d11-be36-175f4abe70e1),volume_type_id=78355e35-bc27-4d11-be36-175f4abe70e1)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c988bb-9fac-4ff8-afb5-637a01fa6cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c988bb-9fac-4ff8-afb5-637a01fa6cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:44 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.info Jul 31 07:29:44 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08df00b-b3ba-474a-a9f3-388bce9675ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08df00b-b3ba-474a-a9f3-388bce9675ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556a0383-e9fc-49b4-98bf-6838f5d1006e', 'volume_name': 'volume-556a0383-e9fc-49b4-98bf-6838f5d1006e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a735a5ec-862c-43b1-ba32-d3335002d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a735a5ec-862c-43b1-ba32-d3335002d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5984d461-c1dc-4127-8e23-6dd69096c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Volume 556a0383-e9fc-49b4-98bf-6838f5d1006e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556a0383-e9fc-49b4-98bf-6838f5d1006e', 'volume_size': 1} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:44 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.info" returned: 0 in 0.305s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c8584df-5710-4a83-b0e7-3963e0d13a94,created_at=2026-07-31T05:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258411731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c8584df-5710-4a83-b0e7-3963e0d13a94,host='devstack@QuobyteHD#QuobyteHD',id=556a0383-e9fc-49b4-98bf-6838f5d1006e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:44Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78355e35-bc27-4d11-be36-175f4abe70e1),volume_type_id=78355e35-bc27-4d11-be36-175f4abe70e1)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Creating volume 556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:44 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:44 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e 1073741824 Jul 31 07:29:44 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6f416f1b-d9b3-4943-8394-ff44832ae1e5 tempest-VolumesDeleteCascade-2024135710 None] Create snapshot completed successfully Jul 31 07:29:44 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e 1073741824" returned: 0 in 0.525s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:44 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e Jul 31 07:29:44 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:45 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e" returned: 0 in 0.309s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5984d461-c1dc-4127-8e23-6dd69096c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556a0383-e9fc-49b4-98bf-6838f5d1006e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f30a8a-9698-48ae-8c3d-36fc1d587862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Volume volume-556a0383-e9fc-49b4-98bf-6838f5d1006e (556a0383-e9fc-49b4-98bf-6838f5d1006e): created successfully Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f30a8a-9698-48ae-8c3d-36fc1d587862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (c7b888e4-818d-40a1-bc8e-0308a1cf4c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-aca946c7-e4ca-4d94-8b78-326f629b2b17 tempest-GroupSnapshotsTest-1145442677 None] Created volume successfully. Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Flow 'volume_create_manager' (ddda445d-3cf0-4e2e-a7d4-250d93baea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47f3df7-e9f0-4f98-a7c1-6d974a5fd935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47f3df7-e9f0-4f98-a7c1-6d974a5fd935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-212562562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4aeeb8-14bf-4109-98f9-c4caf580b617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9ec0105efa492d9fae1879898d710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad722c4f-916a-430f-8a18-e96c34bc4326,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:45Z,use_quota=True,user_id='1de21b0637d44eba97dec80c656a2c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28aabddc-48b2-4108-b820-67e5fb0d62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28aabddc-48b2-4108-b820-67e5fb0d62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb29c5b5-6dc1-4c6a-8ce4-8e00b23a0702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb29c5b5-6dc1-4c6a-8ce4-8e00b23a0702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c4aeeb8-14bf-4109-98f9-c4caf580b617', 'volume_name': 'volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617', 'volume_size': 1, 'snapshot_id': 'ad722c4f-916a-430f-8a18-e96c34bc4326'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f04228c-0972-4c94-aa20-6b59a7df660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f04228c-0972-4c94-aa20-6b59a7df660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360f631e-c890-45b1-8b69-cbc56e01beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Volume 8c4aeeb8-14bf-4109-98f9-c4caf580b617: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617', 'volume_size': 1, 'snapshot_id': 'ad722c4f-916a-430f-8a18-e96c34bc4326'} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-ad722c4f-916a-430f-8a18-e96c34bc4326-8c4aeeb8-14bf-4109-98f9-c4caf580b617" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-ad722c4f-916a-430f-8a18-e96c34bc4326-8c4aeeb8-14bf-4109-98f9-c4caf580b617" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Creating volume 8c4aeeb8-14bf-4109-98f9-c4caf580b617 from snapshot ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-8c4aeeb8-14bf-4109-98f9-c4caf580b617" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-8c4aeeb8-14bf-4109-98f9-c4caf580b617" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] snapshot: ad722c4f-916a-430f-8a18-e96c34bc4326, volume: 8c4aeeb8-14bf-4109-98f9-c4caf580b617, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d3f525-293f-47d1-a6ff-56e7aae0b991]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:45 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 Jul 31 07:29:45 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:46 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326" returned: 0 in 0.395s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37fe4617-0495-48e0-b3fe-8cb06de1129c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d02a7d0-c924-4fe2-9b10-15efeab8a80f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:46 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c Jul 31 07:29:46 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:46 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c" returned: 0 in 0.397s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:46 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 Jul 31 07:29:46 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] GroupSnapshot 19ac8a8d-38a5-4831-b798-4e9d965b244f: creating. Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Group snapshot 19ac8a8d-38a5-4831-b798-4e9d965b244f: creating. {{(pid=88915) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 07:29:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Flow 'volume_create_manager' (7c95bc9a-6974-473e-b202-88b2509f4eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ac486c-5a1f-436f-88f2-6877684ead79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ac486c-5a1f-436f-88f2-6877684ead79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-211307342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b73c5c634727919c8e4a206b52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:51Z,use_quota=True,user_id='ba2b4ee41e9b43c3bfef675b6a39ece6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc5f5e-323d-4cd9-8127-aaceecb64aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc5f5e-323d-4cd9-8127-aaceecb64aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3b30a0-365b-4928-b6c5-0ebbd9bc3935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3b30a0-365b-4928-b6c5-0ebbd9bc3935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d', 'volume_name': 'volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270a3a82-e88a-4779-b827-a41e1d4cdfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270a3a82-e88a-4779-b827-a41e1d4cdfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a3078d-c73f-483e-bf0f-7e6ebc2b282c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:51 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Volume 41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d', 'volume_size': 1} Jul 31 07:29:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:52 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617" returned: 0 in 5.887s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d661a2-af07-46d2-886b-e8e9bd03dac1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:52 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c Jul 31 07:29:52 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:52 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c" returned: 0 in 0.609s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:52 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:29:52 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Converted 1024.00 MB image at 173.89 MB/s Jul 31 07:29:52 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 is being set with open permissions: ugo+rw Jul 31 07:29:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:52 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 Jul 31 07:29:52 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:53 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617" returned: 0 in 0.241s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-8c4aeeb8-14bf-4109-98f9-c4caf580b617" released by "_copy_volume_from_snapshot" :: held 7.655s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-ad722c4f-916a-430f-8a18-e96c34bc4326-8c4aeeb8-14bf-4109-98f9-c4caf580b617" released by "_create_volume_from_snapshot" :: held 7.695s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.717s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.325s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Creating offline snapshot 705717a9-c12d-4365-97b6-6dea7438cbd6 of volume 556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360f631e-c890-45b1-8b69-cbc56e01beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617', 'volume_size': 1, 'snapshot_id': 'ad722c4f-916a-430f-8a18-e96c34bc4326'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6dca67-eed1-40dd-9fe5-f8e790e4d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0233bd5-da05-49ab-958b-11ea9ce60cf5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:53 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Volume volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 (8c4aeeb8-14bf-4109-98f9-c4caf580b617): created successfully Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6dca67-eed1-40dd-9fe5-f8e790e4d59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Flow 'volume_create_manager' (ddda445d-3cf0-4e2e-a7d4-250d93baea8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-16cd6cc5-1276-4dd4-8f63-238fc3b183d4 tempest-VolumesDeleteCascade-2024135710 None] Created volume successfully. Jul 31 07:29:53 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e Jul 31 07:29:53 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:53 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e" returned: 0 in 0.423s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:53 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 1G Jul 31 07:29:53 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:54 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 1G" returned: 0 in 0.421s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a0383-e9fc-49b4-98bf-6838f5d1006e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:54 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a0383-e9fc-49b4-98bf-6838f5d1006e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 Jul 31 07:29:54 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:54 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a0383-e9fc-49b4-98bf-6838f5d1006e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6" returned: 0 in 0.374s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:54 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-37fe4617-0495-48e0-b3fe-8cb06de1129c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:54 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 Jul 31 07:29:54 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-37fe4617-0495-48e0-b3fe-8cb06de1129c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Performing cascade delete. {{(pid=88915) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-ad722c4f-916a-430f-8a18-e96c34bc4326-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-ad722c4f-916a-430f-8a18-e96c34bc4326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-37fe4617-0495-48e0-b3fe-8cb06de1129c" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-37fe4617-0495-48e0-b3fe-8cb06de1129c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-ad722c4f-916a-430f-8a18-e96c34bc4326" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-ad722c4f-916a-430f-8a18-e96c34bc4326" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Deleting offline snapshot ad722c4f-916a-430f-8a18-e96c34bc4326 of volume 37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] snapshot_file for this snap is: volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5d7c27-084f-43ef-b524-6f1060e15e4b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:54 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6" returned: 0 in 0.353s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:54 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 Jul 31 07:29:54 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:54 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.info Jul 31 07:29:54 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:55 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326" returned: 0 in 0.451s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37fe4617-0495-48e0-b3fe-8cb06de1129c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:55 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.info" returned: 0 in 0.377s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:55 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db11488-a47c-4b3d-b2ff-9817b4d293d0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:55 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.info Jul 31 07:29:55 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:55 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c Jul 31 07:29:55 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:55 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.info" returned: 0 in 0.439s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.451s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-211307342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b73c5c634727919c8e4a206b52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:51Z,use_quota=True,user_id='ba2b4ee41e9b43c3bfef675b6a39ece6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Creating volume 41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:55 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:55 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d 1073741824 Jul 31 07:29:55 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:55 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c" returned: 0 in 0.571s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:55 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 Jul 31 07:29:55 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-163f08bb-01cd-4398-82bd-b1ff123aae77 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 19ac8a8d-38a5-4831-b798-4e9d965b244f: created successfully Jul 31 07:29:56 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:56 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d 1073741824" returned: 0 in 0.590s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:56 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326 Jul 31 07:29:56 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (787f5035-b266-4936-90ee-c6a33ee0659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56155454-8c2b-4f27-a692-2a76c9b503a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56155454-8c2b-4f27-a692-2a76c9b503a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1394087174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677b4db6-cfd8-456e-9d5b-8a9e52683320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:56Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1002b3-9a4f-4649-a3d4-f97d2c3e753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1002b3-9a4f-4649-a3d4-f97d2c3e753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e571d9-945d-4654-ac37-87cb76f6a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e571d9-945d-4654-ac37-87cb76f6a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677b4db6-cfd8-456e-9d5b-8a9e52683320', 'volume_name': 'volume-677b4db6-cfd8-456e-9d5b-8a9e52683320', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d34ff67-f0b7-4222-9b18-03ced6948be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d34ff67-f0b7-4222-9b18-03ced6948be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772dd7f-4bc6-4cb5-81fc-c0b51f827a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:56 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Volume 677b4db6-cfd8-456e-9d5b-8a9e52683320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677b4db6-cfd8-456e-9d5b-8a9e52683320', 'volume_size': 1} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:56 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d Jul 31 07:29:56 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:56 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c.ad722c4f-916a-430f-8a18-e96c34bc4326" returned: 0 in 0.269s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-ad722c4f-916a-430f-8a18-e96c34bc4326" released by "_delete_snapshot" :: held 1.908s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-37fe4617-0495-48e0-b3fe-8cb06de1129c" released by "delete_snapshot" :: held 1.934s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Created reservations ['c1919fa0-db2f-4351-bbd1-c4a656ca911b', '841ce16b-4cf5-4f07-82c7-cbe502f9b3a7', '2cba57dd-2fc2-4ee5-b2be-80103b3375ba', '6c39c2a6-4ef1-43a3-a258-be70e7b008c5'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:56 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" returned: 0 in 0.279s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1394087174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677b4db6-cfd8-456e-9d5b-8a9e52683320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:29:56Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Creating volume 677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:56 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a3078d-c73f-483e-bf0f-7e6ebc2b282c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66657684-4bcf-454c-8303-d793766c71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:56 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 1073741824 Jul 31 07:29:56 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:56 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Volume volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d (41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d): created successfully Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66657684-4bcf-454c-8303-d793766c71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Flow 'volume_create_manager' (7c95bc9a-6974-473e-b202-88b2509f4eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-67e7f49f-833b-4f7b-8bef-5af0199eb8ad tempest-SnapshotMetadataTestJSON-1938504512 None] Created volume successfully. Jul 31 07:29:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Delete snapshot completed successfully. Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-ad722c4f-916a-430f-8a18-e96c34bc4326-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Snapshots deleted, issuing volume delete {{(pid=88915) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-37fe4617-0495-48e0-b3fe-8cb06de1129c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-37fe4617-0495-48e0-b3fe-8cb06de1129c" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce84b45-a4af-4b4a-9d1e-f87b779b01f6]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:57 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c Jul 31 07:29:57 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:57 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 1073741824" returned: 0 in 0.565s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:57 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 Jul 31 07:29:57 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:57 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c" returned: 0 in 0.502s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:57 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c Jul 31 07:29:57 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:57 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320" returned: 0 in 0.367s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.462s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-705717a9-c12d-4365-97b6-6dea7438cbd6-f8576d59-02d5-4682-bcee-8a5a69fd7234" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772dd7f-4bc6-4cb5-81fc-c0b51f827a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677b4db6-cfd8-456e-9d5b-8a9e52683320', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2658a189-e945-4050-aa94-31abb2d03349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-705717a9-c12d-4365-97b6-6dea7438cbd6-f8576d59-02d5-4682-bcee-8a5a69fd7234" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Creating volume f8576d59-02d5-4682-bcee-8a5a69fd7234 from snapshot 705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-f8576d59-02d5-4682-bcee-8a5a69fd7234" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:57 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-37fe4617-0495-48e0-b3fe-8cb06de1129c" returned: 0 in 0.333s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:57 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Volume volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 (677b4db6-cfd8-456e-9d5b-8a9e52683320): created successfully Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2658a189-e945-4050-aa94-31abb2d03349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (787f5035-b266-4936-90ee-c6a33ee0659c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-37fe4617-0495-48e0-b3fe-8cb06de1129c" released by "delete_volume" :: held 0.917s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-f8576d59-02d5-4682-bcee-8a5a69fd7234" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] snapshot: 705717a9-c12d-4365-97b6-6dea7438cbd6, volume: f8576d59-02d5-4682-bcee-8a5a69fd7234, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:29:57 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-afb79116-2bcd-4993-a684-e1d7ec934912 tempest-VolumesSnapshotTestJSON-394949413 None] Created volume successfully. Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cfaeaf-8535-45b8-adc7-4f3a64d2fefd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:57 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Created reservations ['7aee58db-cf7c-4b87-a8dc-234d13918238', '1f836a2a-12bc-434f-94cb-fbe77a969adb', 'e773befc-dcd6-4362-940e-10b68b74de27', 'b2c71528-9ee5-4bb4-9d38-3ce04089d030'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:58 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 Jul 31 07:29:58 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:58 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:29:58 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:58 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.252s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:29:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Deleted volume successfully. Jul 31 07:29:58 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6" returned: 0 in 0.363s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a0383-e9fc-49b4-98bf-6838f5d1006e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b7a168-9069-466f-8964-38a26b37d726]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-887a7d4d-e540-4828-937c-ca6adf0767c1 tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-37fe4617-0495-48e0-b3fe-8cb06de1129c-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:29:58 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e Jul 31 07:29:58 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:29:58 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e" returned: 0 in 0.412s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:29:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:58 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 Jul 31 07:29:58 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-8c4aeeb8-14bf-4109-98f9-c4caf580b617-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-8c4aeeb8-14bf-4109-98f9-c4caf580b617-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "cinder-quobyte-8c4aeeb8-14bf-4109-98f9-c4caf580b617" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-8c4aeeb8-14bf-4109-98f9-c4caf580b617" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b554a-0e51-4f15-93c2-92a301c9f763]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:59 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 Jul 31 07:29:59 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:29:59 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617" returned: 0 in 0.494s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:29:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:29:59 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617 Jul 31 07:29:59 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:00 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8c4aeeb8-14bf-4109-98f9-c4caf580b617" returned: 0 in 0.526s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-quobyte-8c4aeeb8-14bf-4109-98f9-c4caf580b617" released by "delete_volume" :: held 1.086s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Created reservations ['de72cea9-862a-4ed2-bb91-4de7cdb8f5c5', '4a1dba20-ce06-4d22-9f3c-4c926252f68b', '2aaaed2a-d576-4f41-b90e-fb87f2839fb3', '4f0b0d05-f9f6-48a8-8406-12657a7e4e3a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:00 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:00 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:00 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.410s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:00 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:00 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Deleted volume successfully. Jul 31 07:30:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05e9aa18-a22c-4e1b-a6d6-cf80d7ffecea tempest-VolumesDeleteCascade-2024135710 None] Lock "cinder-8c4aeeb8-14bf-4109-98f9-c4caf580b617-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:03 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234" returned: 0 in 4.848s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efe0a5-3be4-4f8e-9a4e-429ab0e979d1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:03 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e Jul 31 07:30:03 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:04 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e" returned: 0 in 0.557s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:30:04 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Converted 1024.00 MB image at 211.16 MB/s Jul 31 07:30:04 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:04 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 Jul 31 07:30:04 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:04 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234" returned: 0 in 0.247s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-f8576d59-02d5-4682-bcee-8a5a69fd7234" released by "_copy_volume_from_snapshot" :: held 6.603s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-705717a9-c12d-4365-97b6-6dea7438cbd6-f8576d59-02d5-4682-bcee-8a5a69fd7234" released by "_create_volume_from_snapshot" :: held 6.662s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.702s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.716s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Creating offline snapshot bfe13867-22bb-47a8-933f-ee2aa2be5f7b of volume 41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c81495-8968-4b1f-af66-01d1fb2b1dda]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a3b151e4-aea1-4a8d-bb8f-5683e9d41245 tempest-GroupSnapshotsTest-1145442677 None] Create group from source-snapshot-19ac8a8d-38a5-4831-b798-4e9d965b244f completed successfully. Jul 31 07:30:04 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d Jul 31 07:30:04 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:04 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" returned: 0 in 0.432s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:04 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b 1G Jul 31 07:30:04 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:05 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b 1G" returned: 0 in 0.470s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:05 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b Jul 31 07:30:05 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-f8576d59-02d5-4682-bcee-8a5a69fd7234" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-f8576d59-02d5-4682-bcee-8a5a69fd7234" acquired by "delete_volume" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c408fd-d915-4941-878a-a48657f36711]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Flow 'volume_create_manager' (7dbcfa76-3f26-4a2a-b8a0-db14bfee5a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:05 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 Jul 31 07:30:05 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af47abca-fe43-49e0-b87c-997d8299f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af47abca-fe43-49e0-b87c-997d8299f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1435663195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a04fe9-aa75-40bd-b70b-7e51682f3b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24cff3adec33472c8a1fa50d46ac1fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:06Z,use_quota=True,user_id='e4932c98e4d74648b09e997858bacfe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78601a67-deb1-4d79-adb1-9e85df948845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78601a67-deb1-4d79-adb1-9e85df948845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2080b280-c464-4eef-b4cc-dbdb961a71ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2080b280-c464-4eef-b4cc-dbdb961a71ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59a04fe9-aa75-40bd-b70b-7e51682f3b8c', 'volume_name': 'volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c669c21d-5886-4cce-a7aa-71efd5929583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c669c21d-5886-4cce-a7aa-71efd5929583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a00ec0c-7981-4905-939a-d72a915b4680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Volume 59a04fe9-aa75-40bd-b70b-7e51682f3b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c', 'volume_size': 1} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:05 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b" returned: 0 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:05 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b is being set with open permissions: ugo+rw Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:05 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b Jul 31 07:30:05 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:05 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234" returned: 0 in 0.391s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:05 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234 Jul 31 07:30:06 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:06 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b" returned: 0 in 0.261s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:06 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.info Jul 31 07:30:06 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:06 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f8576d59-02d5-4682-bcee-8a5a69fd7234" returned: 0 in 0.249s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-f8576d59-02d5-4682-bcee-8a5a69fd7234" released by "delete_volume" :: held 0.706s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['d214bdcf-3000-40ac-a961-f82450a48bfa'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:06 devstack cinder-volume[88915]: WARNING cinder.quota [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-250424976 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-250424976, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:30:06 devstack cinder-volume[88915]: WARNING cinder.quota [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-250424976 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-250424976, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:30:06 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.info" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:06 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.info is being set with open permissions: ugo+rw Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['4f0fb454-8f51-40c0-8e9e-5b4e19725375', '15b591f9-65e9-4ac6-9c85-7a175e2d2e04', '9ee04d51-407b-425e-83b8-24e4f9c10eac', 'ba70b595-666b-4c81-9b20-d7beaaa080dd'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:06 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.info Jul 31 07:30:06 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:06 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:06 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:06 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.info" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.935s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Creating offline snapshot c2037b07-b498-436c-81f2-ad2bcb757b4c of volume 677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:30:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fb8f67ba-7f08-401c-befa-8865c224d48d tempest-SnapshotMetadataTestJSON-1938504512 None] Create snapshot completed successfully Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e120ad1-9dd5-46c3-bd74-0f7c4f80ee21]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:06 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f8c33993-732e-4a66-959d-889bce9ea29d tempest-GroupSnapshotsTest-1145442677 None] Delete group completed successfully. Jul 31 07:30:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 19ac8a8d-38a5-4831-b798-4e9d965b244f: deleting Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 19ac8a8d-38a5-4831-b798-4e9d965b244f: deleting {{(pid=88915) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 07:30:06 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 Jul 31 07:30:06 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-556a0383-e9fc-49b4-98bf-6838f5d1006e" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-556a0383-e9fc-49b4-98bf-6838f5d1006e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-705717a9-c12d-4365-97b6-6dea7438cbd6" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-705717a9-c12d-4365-97b6-6dea7438cbd6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Deleting offline snapshot 705717a9-c12d-4365-97b6-6dea7438cbd6 of volume 556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] snapshot_file for this snap is: volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5415eb8b-3b38-4d2b-8b30-98e8c5cf9a7e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:07 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 Jul 31 07:30:07 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:07 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320" returned: 0 in 0.393s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:07 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c 1G Jul 31 07:30:07 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:07 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6" returned: 0 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a0383-e9fc-49b4-98bf-6838f5d1006e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6354a8-1d7e-41bc-a488-d393bae16189]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:07 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e Jul 31 07:30:07 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:07 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c 1G" returned: 0 in 0.473s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:07 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c Jul 31 07:30:07 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:07 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e" returned: 0 in 0.452s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:07 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 Jul 31 07:30:07 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:07 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c" returned: 0 in 0.353s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:07 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c is being set with open permissions: ugo+rw Jul 31 07:30:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:07 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c Jul 31 07:30:07 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:08 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6" returned: 0 in 0.403s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "cinder-bfe13867-22bb-47a8-933f-ee2aa2be5f7b-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:08 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:08 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6 Jul 31 07:30:08 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-bfe13867-22bb-47a8-933f-ee2aa2be5f7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "cinder-quobyte-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-quobyte-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "cinder-quobyte-bfe13867-22bb-47a8-933f-ee2aa2be5f7b" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-quobyte-bfe13867-22bb-47a8-933f-ee2aa2be5f7b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Deleting offline snapshot bfe13867-22bb-47a8-933f-ee2aa2be5f7b of volume 41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:08 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.info Jul 31 07:30:08 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] snapshot_file for this snap is: volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[46657dd1-43e3-47ce-98b0-04bb2d43cda5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:08 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b Jul 31 07:30:08 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:08 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e.705717a9-c12d-4365-97b6-6dea7438cbd6" returned: 0 in 0.284s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-705717a9-c12d-4365-97b6-6dea7438cbd6" released by "_delete_snapshot" :: held 1.615s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-556a0383-e9fc-49b4-98bf-6838f5d1006e" released by "delete_snapshot" :: held 1.638s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:08 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.info" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:08 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.info is being set with open permissions: ugo+rw Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:08 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.info Jul 31 07:30:08 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:08 devstack cinder-volume[88915]: WARNING cinder.quota [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-250424976 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-250424976, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['3df83068-090a-4824-b976-4e8bbb884b84', '6a3684e3-ac9b-4f99-be26-2126d482711b', '6ae30229-f906-4768-943d-3b54a72addb3', '80f8171e-9485-48cb-a351-fadfecfc56a0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e55e86b9-6d0b-4185-9e0f-2d372b5adba3 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 19ac8a8d-38a5-4831-b798-4e9d965b244f: deleted successfully Jul 31 07:30:08 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b" returned: 0 in 0.432s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fea12b0-77bc-434c-ab09-81a75e49fff0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:08 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.info" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.051s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1435663195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a04fe9-aa75-40bd-b70b-7e51682f3b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24cff3adec33472c8a1fa50d46ac1fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:06Z,use_quota=True,user_id='e4932c98e4d74648b09e997858bacfe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Creating volume 59a04fe9-aa75-40bd-b70b-7e51682f3b8c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:08 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:08 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c 1073741824 Jul 31 07:30:08 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:08 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d Jul 31 07:30:08 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-47eadba8-3234-497f-9d0e-0c5beb34bf5b tempest-VolumesSnapshotTestJSON-394949413 None] Create snapshot completed successfully Jul 31 07:30:09 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:09 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b Jul 31 07:30:09 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:09 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c 1073741824" returned: 0 in 0.461s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:09 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c Jul 31 07:30:09 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-556a0383-e9fc-49b4-98bf-6838f5d1006e" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-556a0383-e9fc-49b4-98bf-6838f5d1006e" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b4733d-dfac-4dfc-9088-520ebf3efeb8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:09 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:09 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e Jul 31 07:30:09 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b" returned: 0 in 0.467s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:09 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b Jul 31 07:30:09 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:09 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c" returned: 0 in 0.344s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a00ec0c-7981-4905-939a-d72a915b4680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d5d59c-e4ba-4449-b333-eb36a2bf146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-c2037b07-b498-436c-81f2-ad2bcb757b4c-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Volume volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c (59a04fe9-aa75-40bd-b70b-7e51682f3b8c): created successfully Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d5d59c-e4ba-4449-b333-eb36a2bf146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Flow 'volume_create_manager' (7dbcfa76-3f26-4a2a-b8a0-db14bfee5a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-c2037b07-b498-436c-81f2-ad2bcb757b4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-70893bf4-1aae-487e-a21b-16f2ad433bef tempest-VolumesMetadataTest-203297954 None] Created volume successfully. Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-677b4db6-cfd8-456e-9d5b-8a9e52683320" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-677b4db6-cfd8-456e-9d5b-8a9e52683320" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-c2037b07-b498-436c-81f2-ad2bcb757b4c" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-c2037b07-b498-436c-81f2-ad2bcb757b4c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Deleting offline snapshot c2037b07-b498-436c-81f2-ad2bcb757b4c of volume 677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] snapshot_file for this snap is: volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[273564c9-81ce-4164-9f73-6730907f2056]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:09 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d.bfe13867-22bb-47a8-933f-ee2aa2be5f7b" returned: 0 in 0.306s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:09 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e" returned: 0 in 0.500s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-quobyte-bfe13867-22bb-47a8-933f-ee2aa2be5f7b" released by "_delete_snapshot" :: held 1.709s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-quobyte-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" released by "delete_snapshot" :: held 1.754s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:10 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e Jul 31 07:30:10 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:10 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c Jul 31 07:30:10 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Created reservations ['11607403-b42d-467a-a4a6-8542dda1358d', '3c03ab42-9efc-40cd-80dd-aec01be85420', 'e24f0c64-6416-4942-9485-5bcee9bf8f98', '0dd5be4b-1ba0-4126-b9ea-52c5bfda4f58'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Delete snapshot completed successfully. Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-023d6013-5380-4a81-8a38-80d623f32377 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-bfe13867-22bb-47a8-933f-ee2aa2be5f7b-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:10 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-556a0383-e9fc-49b4-98bf-6838f5d1006e" returned: 0 in 0.247s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-556a0383-e9fc-49b4-98bf-6838f5d1006e" released by "delete_volume" :: held 0.819s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:10 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['758cdbf5-25cf-4b76-8893-e3a850dcc8d1'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c" returned: 0 in 0.393s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-677b4db6-cfd8-456e-9d5b-8a9e52683320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0e7eb5-aea7-476d-ba22-26cc26f88f2d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:10 devstack cinder-volume[88915]: WARNING cinder.db.api [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-250424976'] Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['ed1b654c-0dfd-4259-9009-4ca64ce17877', '609a97e1-05c0-4cc7-aa7e-69431681a572', '76671958-9eab-4ddf-92e3-25ff4ef0c77e', '5f44ad66-8563-446a-bc76-7134959cfa9c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:10 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 Jul 31 07:30:10 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "cinder-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "cinder-quobyte-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:10 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:10 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-quobyte-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c51de-d780-42e3-a166-1fd744ddb4e1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:10 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320" returned: 0 in 0.418s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:10 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d Jul 31 07:30:10 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:10 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c Jul 31 07:30:10 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:10 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.287s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:10 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f4166bd0-0b8f-4511-ab01-5594a3fb535d tempest-GroupSnapshotsTest-1145442677 None] Delete group completed successfully. Jul 31 07:30:11 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" returned: 0 in 0.463s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:11 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d Jul 31 07:30:11 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cd52ec73-be11-406b-8882-e6d34c30fcd7 tempest-GroupSnapshotsTest-1145442677 None] Group tempest-GroupSnapshotsTest-Group-676475887: creating Jul 31 07:30:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cd52ec73-be11-406b-8882-e6d34c30fcd7 tempest-GroupSnapshotsTest-1145442677 None] Group tempest-GroupSnapshotsTest-Group-676475887: created successfully Jul 31 07:30:11 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cd52ec73-be11-406b-8882-e6d34c30fcd7 tempest-GroupSnapshotsTest-1145442677 None] Create group completed successfully. Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c" returned: 0 in 0.486s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:11 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c Jul 31 07:30:11 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:11 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" returned: 0 in 0.295s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-quobyte-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d" released by "delete_volume" :: held 0.847s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Created reservations ['634df22b-58c1-4d73-90b1-c4bbb9597aa7', 'ae22a48b-de1a-4e22-8dc7-470e0fdcf1bb', '41c495ed-6cbe-4834-ad68-9fa52088a234', 'ded5edbf-0aa7-41b7-a33a-d704cd8c01fc'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:11 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320.c2037b07-b498-436c-81f2-ad2bcb757b4c" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-c2037b07-b498-436c-81f2-ad2bcb757b4c" released by "_delete_snapshot" :: held 1.715s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-677b4db6-cfd8-456e-9d5b-8a9e52683320" released by "delete_snapshot" :: held 1.747s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:11 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:11 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['9105691c-eafb-47d4-810b-0e48f5fc336a', '65910252-11f3-4492-a067-97818ee02242', 'bafe9f40-94f3-4c14-a19e-38b0db205c01', '2f5d15af-51c0-4b5d-9cff-9b99633f3819'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Delete snapshot completed successfully. Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63105f11-e32f-411c-b4a1-4af00ac60dcc tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-c2037b07-b498-436c-81f2-ad2bcb757b4c-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Acquiring lock "cinder-59a04fe9-aa75-40bd-b70b-7e51682f3b8c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Lock "cinder-59a04fe9-aa75-40bd-b70b-7e51682f3b8c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Acquiring lock "cinder-quobyte-59a04fe9-aa75-40bd-b70b-7e51682f3b8c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Lock "cinder-quobyte-59a04fe9-aa75-40bd-b70b-7e51682f3b8c" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:11 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.367s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Deleted volume successfully. Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7638d6a6-319a-44c1-a6f2-55f0888577ce]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f910459d-9546-493e-9829-f470f1098e08 tempest-SnapshotMetadataTestJSON-1938504512 None] Lock "cinder-41d1ae26-4ed5-4af7-a221-d8a6da8b3b7d-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:12 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c Jul 31 07:30:12 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:12 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c" returned: 0 in 0.511s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:12 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c Jul 31 07:30:12 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (602f50cc-3da3-4dfd-b8ad-4ee57800bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e2a01a-8418-426d-a1f0-8798b3c4aa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e2a01a-8418-426d-a1f0-8798b3c4aa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1913392879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7b2422-34e0-47c2-b1f3-966c9b5648db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:13Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b445ee58-571c-431d-a426-df270e8d8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b445ee58-571c-431d-a426-df270e8d8946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d71451f-5034-4358-a85b-f096ab259c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d71451f-5034-4358-a85b-f096ab259c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7b2422-34e0-47c2-b1f3-966c9b5648db', 'volume_name': 'volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcd3ef4-cfe9-427d-8d22-bed8cb75d739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcd3ef4-cfe9-427d-8d22-bed8cb75d739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe07ff8-81e8-4c78-b9ba-d0fb663d84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:12 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Volume 8b7b2422-34e0-47c2-b1f3-966c9b5648db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db', 'volume_size': 1} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1913392879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7b2422-34e0-47c2-b1f3-966c9b5648db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:13Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Creating volume 8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:12 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:12 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db 1073741824 Jul 31 07:30:12 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:12 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-59a04fe9-aa75-40bd-b70b-7e51682f3b8c" returned: 0 in 0.385s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Lock "cinder-quobyte-59a04fe9-aa75-40bd-b70b-7e51682f3b8c" released by "delete_volume" :: held 0.977s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Created reservations ['e15700ec-e1c0-473a-ada7-08d22c9586de', 'f111a5e7-2bc7-4740-9042-2d2f1d96b439', 'bed17814-7281-4cfd-bb44-6d681fa55c81', 'b06e6595-6ed5-40cc-b299-db928f0db2e9'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (e0dd7744-41eb-45b9-ada1-d671b0a8ca2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed92411-6cc5-4629-8bde-343bb03951f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed92411-6cc5-4629-8bde-343bb03951f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602709749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e93c8758-3ac3-4dd3-8fe4-74b8b62d3231,host='devstack@QuobyteHD#QuobyteHD',id=a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:13Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a0d0a7c-6130-4f14-8531-d62f403baa40),volume_type_id=7a0d0a7c-6130-4f14-8531-d62f403baa40)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41af090b-2ff8-4251-be50-9a3594406c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41af090b-2ff8-4251-be50-9a3594406c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cfee9c-dfd4-45a3-b923-9f9d4ee35bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cfee9c-dfd4-45a3-b923-9f9d4ee35bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5', 'volume_name': 'volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a050578-2b89-4146-95c8-80f95e42bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a050578-2b89-4146-95c8-80f95e42bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8912255f-eed3-414d-945c-e8593ea51891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:13 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Volume a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5', 'volume_size': 1} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:13 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:13 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:13 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db 1073741824" returned: 0 in 0.562s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:13 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db Jul 31 07:30:13 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:13 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Deleted volume successfully. Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ab2b45e-f853-4728-8bab-e6aa8d6d84b2 tempest-VolumesMetadataTest-203297954 None] Lock "cinder-59a04fe9-aa75-40bd-b70b-7e51682f3b8c-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:13 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db" returned: 0 in 0.296s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e93c8758-3ac3-4dd3-8fe4-74b8b62d3231,created_at=2026-07-31T05:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602709749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e93c8758-3ac3-4dd3-8fe4-74b8b62d3231,host='devstack@QuobyteHD#QuobyteHD',id=a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:13Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a0d0a7c-6130-4f14-8531-d62f403baa40),volume_type_id=7a0d0a7c-6130-4f14-8531-d62f403baa40)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Creating volume a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:13 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:13 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 1073741824 Jul 31 07:30:13 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe07ff8-81e8-4c78-b9ba-d0fb663d84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ab00be-1e1f-4d77-bd4b-b737a510048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:13 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Volume volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db (8b7b2422-34e0-47c2-b1f3-966c9b5648db): created successfully Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ab00be-1e1f-4d77-bd4b-b737a510048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (602f50cc-3da3-4dfd-b8ad-4ee57800bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d31748e9-bdaf-4363-bc25-c14748876da6 tempest-VolumesSnapshotTestJSON-394949413 None] Created volume successfully. Jul 31 07:30:14 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 1073741824" returned: 0 in 0.424s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:14 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 Jul 31 07:30:14 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:14 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" returned: 0 in 0.305s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8912255f-eed3-414d-945c-e8593ea51891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798cdf53-fa12-4dc9-a9f7-e71bddcd3ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Volume volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 (a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5): created successfully Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798cdf53-fa12-4dc9-a9f7-e71bddcd3ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (e0dd7744-41eb-45b9-ada1-d671b0a8ca2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-dfbc5ad7-ffcd-4744-819a-145d9f595319 tempest-GroupSnapshotsTest-1145442677 None] Created volume successfully. Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Creating offline snapshot 64a8f9b3-3d8b-405c-88ec-0b601c407548 of volume 8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84cec6e-7c73-4835-a4d4-2e3ee5be2c2f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:15 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db Jul 31 07:30:15 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:15 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db" returned: 0 in 0.446s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:15 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 1G Jul 31 07:30:15 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:15 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 1G" returned: 0 in 0.595s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:15 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 Jul 31 07:30:15 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (29dfae4c-6f09-441c-a08c-1517e41bfe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297f3e91-0860-4f22-9777-61199c562ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297f3e91-0860-4f22-9777-61199c562ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874795438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e93c8758-3ac3-4dd3-8fe4-74b8b62d3231,host='devstack@QuobyteHD#QuobyteHD',id=42a54b72-1d00-4395-b6f0-0ebc5ab8ab93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:16Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a0d0a7c-6130-4f14-8531-d62f403baa40),volume_type_id=7a0d0a7c-6130-4f14-8531-d62f403baa40)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e55a6d1-20db-49b7-9b9a-0f16848900b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e55a6d1-20db-49b7-9b9a-0f16848900b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b569877-b757-4608-8bf1-ff1b4a4e1661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b569877-b757-4608-8bf1-ff1b4a4e1661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a54b72-1d00-4395-b6f0-0ebc5ab8ab93', 'volume_name': 'volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1ad118-2750-403b-b1a8-54417287c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1ad118-2750-403b-b1a8-54417287c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037ce588-1e67-434f-9d5e-086929276e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Volume 42a54b72-1d00-4395-b6f0-0ebc5ab8ab93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93', 'volume_size': 1} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:16 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:16 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 is being set with open permissions: ugo+rw Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:16 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 Jul 31 07:30:16 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:16 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548" returned: 0 in 0.308s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:16 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.info Jul 31 07:30:16 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Flow 'volume_create_manager' (6aafb1cc-9c3e-4370-934f-fb8956cc2945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea844c94-86a6-4b6d-8e80-852e064ddf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea844c94-86a6-4b6d-8e80-852e064ddf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1097099235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57852265-bb6f-403d-8c04-e06c7cc63315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac863063ed742a9b46834f61488127e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:17Z,use_quota=True,user_id='4a0a77b73d134b2088546f9665ee4770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081783b5-0b97-448d-a7f0-ac80d51d75d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081783b5-0b97-448d-a7f0-ac80d51d75d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd16189e-93da-4778-9120-4a22e1fc011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd16189e-93da-4778-9120-4a22e1fc011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57852265-bb6f-403d-8c04-e06c7cc63315', 'volume_name': 'volume-57852265-bb6f-403d-8c04-e06c7cc63315', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebba452-53f9-4ca3-aeea-747460ee9a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebba452-53f9-4ca3-aeea-747460ee9a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ba14d6-71ae-484f-b0bd-69318f92acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Volume 57852265-bb6f-403d-8c04-e06c7cc63315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57852265-bb6f-403d-8c04-e06c7cc63315', 'volume_size': 1} Jul 31 07:30:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:17 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.info" returned: 0 in 0.294s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:17 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.info is being set with open permissions: ugo+rw Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:17 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.info Jul 31 07:30:17 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:17 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.info" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e93c8758-3ac3-4dd3-8fe4-74b8b62d3231,created_at=2026-07-31T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874795438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e93c8758-3ac3-4dd3-8fe4-74b8b62d3231,host='devstack@QuobyteHD#QuobyteHD',id=42a54b72-1d00-4395-b6f0-0ebc5ab8ab93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:16Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a0d0a7c-6130-4f14-8531-d62f403baa40),volume_type_id=7a0d0a7c-6130-4f14-8531-d62f403baa40)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Creating volume 42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:17 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:17 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 1073741824 Jul 31 07:30:17 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-69bf7665-ba6f-4e33-a8d8-3e8ad2b17bba tempest-VolumesSnapshotTestJSON-394949413 None] Create snapshot completed successfully Jul 31 07:30:17 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 1073741824" returned: 0 in 0.526s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:17 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 Jul 31 07:30:17 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:18 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.263s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1097099235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57852265-bb6f-403d-8c04-e06c7cc63315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac863063ed742a9b46834f61488127e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:17Z,use_quota=True,user_id='4a0a77b73d134b2088546f9665ee4770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Creating volume 57852265-bb6f-403d-8c04-e06c7cc63315 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:18 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037ce588-1e67-434f-9d5e-086929276e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caf9d9d-ca3d-4467-bf6b-cf8c665eccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:18 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 1073741824 Jul 31 07:30:18 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Volume volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 (42a54b72-1d00-4395-b6f0-0ebc5ab8ab93): created successfully Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caf9d9d-ca3d-4467-bf6b-cf8c665eccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (29dfae4c-6f09-441c-a08c-1517e41bfe0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0df94b4d-3090-4bc5-8390-f9b130dd5124 tempest-GroupSnapshotsTest-1145442677 None] Created volume successfully. Jul 31 07:30:18 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 1073741824" returned: 0 in 0.645s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:18 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 Jul 31 07:30:18 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (f0584826-97c7-4550-b7c9-628e7cb595ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b1dedc-d67e-429a-a40d-1c5bda2caabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b1dedc-d67e-429a-a40d-1c5bda2caabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1222325191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805e8eeb-aa2e-49d8-92ee-c8517776f54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=64a8f9b3-3d8b-405c-88ec-0b601c407548,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:19Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfae8144-4016-4c9e-a993-f7f78b221c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfae8144-4016-4c9e-a993-f7f78b221c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1587a045-8306-4428-8146-a511e1966ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1587a045-8306-4428-8146-a511e1966ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '805e8eeb-aa2e-49d8-92ee-c8517776f54d', 'volume_name': 'volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d', 'volume_size': 2, 'snapshot_id': '64a8f9b3-3d8b-405c-88ec-0b601c407548'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87649eb0-691b-4a1f-8cea-9d10e66b00ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87649eb0-691b-4a1f-8cea-9d10e66b00ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a57b35c-8a2f-4d75-916e-729c2ecfec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Volume 805e8eeb-aa2e-49d8-92ee-c8517776f54d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d', 'volume_size': 2, 'snapshot_id': '64a8f9b3-3d8b-405c-88ec-0b601c407548'} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-981366f0-bf72-43b2-9530-20d141684498 tempest-GroupSnapshotsTest-1145442677 None] Update group completed successfully. Jul 31 07:30:19 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315" returned: 0 in 0.348s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.049s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-64a8f9b3-3d8b-405c-88ec-0b601c407548-805e8eeb-aa2e-49d8-92ee-c8517776f54d" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ba14d6-71ae-484f-b0bd-69318f92acda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57852265-bb6f-403d-8c04-e06c7cc63315', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c65fff-9c11-4ee1-90b2-7d16282e38f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-64a8f9b3-3d8b-405c-88ec-0b601c407548-805e8eeb-aa2e-49d8-92ee-c8517776f54d" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Creating volume 805e8eeb-aa2e-49d8-92ee-c8517776f54d from snapshot 64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-805e8eeb-aa2e-49d8-92ee-c8517776f54d" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Volume volume-57852265-bb6f-403d-8c04-e06c7cc63315 (57852265-bb6f-403d-8c04-e06c7cc63315): created successfully Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c65fff-9c11-4ee1-90b2-7d16282e38f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Flow 'volume_create_manager' (6aafb1cc-9c3e-4370-934f-fb8956cc2945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-805e8eeb-aa2e-49d8-92ee-c8517776f54d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] snapshot: 64a8f9b3-3d8b-405c-88ec-0b601c407548, volume: 805e8eeb-aa2e-49d8-92ee-c8517776f54d, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:30:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fdf945af-9927-4913-ba8e-faaa6702a8ad tempest-AbsoluteLimitsTests-1513933853 None] Created volume successfully. Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f0819-1b15-424e-adbe-1f374b178a1e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:19 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 Jul 31 07:30:19 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:19 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548" returned: 0 in 0.392s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d8df5-fd1e-40d2-bdfd-42c86207be78]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:19 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db Jul 31 07:30:19 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:20 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db" returned: 0 in 0.438s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Acquiring lock "cinder-57852265-bb6f-403d-8c04-e06c7cc63315-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:20 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d Jul 31 07:30:20 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Lock "cinder-57852265-bb6f-403d-8c04-e06c7cc63315-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Acquiring lock "cinder-quobyte-57852265-bb6f-403d-8c04-e06c7cc63315" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Lock "cinder-quobyte-57852265-bb6f-403d-8c04-e06c7cc63315" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:20 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-90c8509e-658d-4a89-9d5c-bfccd7b0a60a tempest-GroupSnapshotsTest-1145442677 None] Update group completed successfully. Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5fb4f-cc94-486d-878f-99f4deb98bef]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:20 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 Jul 31 07:30:20 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:20 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315" returned: 0 in 0.403s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:20 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315 Jul 31 07:30:20 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:21 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-57852265-bb6f-403d-8c04-e06c7cc63315" returned: 0 in 0.761s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Lock "cinder-quobyte-57852265-bb6f-403d-8c04-e06c7cc63315" released by "delete_volume" :: held 1.255s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Created reservations ['68c15f15-d955-484e-97c4-c08acea2df15', '669c8520-0bfd-4f13-8ad1-e5faab4aa76b', '92219be9-4eca-4bd2-a422-40c60490f54f', 'd2a99a37-06a2-44c3-a688-9bec7879e8f8'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b4d3a7df-41fd-4846-9fa2-c525742a82e7 tempest-GroupSnapshotsTest-1145442677 None] Update group completed successfully. Jul 31 07:30:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:22 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:22 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:23 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.812s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:23 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Deleted volume successfully. Jul 31 07:30:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8c5ddf67-6df6-4f7f-b9c4-61e4bdcfdc0a tempest-AbsoluteLimitsTests-1513933853 None] Lock "cinder-57852265-bb6f-403d-8c04-e06c7cc63315-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ae102270-c9ad-4299-a482-84c92912c398 tempest-GroupSnapshotsTest-1145442677 None] Update group completed successfully. Jul 31 07:30:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] GroupSnapshot b4dad42a-0103-416b-860c-aa36c5322512: creating. Jul 31 07:30:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Group snapshot b4dad42a-0103-416b-860c-aa36c5322512: creating. {{(pid=88915) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 07:30:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:26 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d" returned: 0 in 6.071s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:26 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[46463fd2-c14f-4a62-ade6-92ec6e8f9976]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:26 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db Jul 31 07:30:26 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:27 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db" returned: 0 in 0.737s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:30:27 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Converted 1024.00 MB image at 168.64 MB/s Jul 31 07:30:27 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d is being set with open permissions: ugo+rw Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:27 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d Jul 31 07:30:27 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:27 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d" returned: 0 in 0.288s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-805e8eeb-aa2e-49d8-92ee-c8517776f54d" released by "_copy_volume_from_snapshot" :: held 8.042s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-64a8f9b3-3d8b-405c-88ec-0b601c407548-805e8eeb-aa2e-49d8-92ee-c8517776f54d" released by "_create_volume_from_snapshot" :: held 8.089s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.118s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.249s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Creating offline snapshot 92063511-558e-4974-b6bc-e46f9f88764f of volume 42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a57b35c-8a2f-4d75-916e-729c2ecfec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d', 'volume_size': 2, 'snapshot_id': '64a8f9b3-3d8b-405c-88ec-0b601c407548'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00f850a-78e7-4bc9-96cc-5abdf18b4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2533baff-2b75-47ea-a42e-66d979b9c655]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:27 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Volume volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d (805e8eeb-aa2e-49d8-92ee-c8517776f54d): created successfully Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00f850a-78e7-4bc9-96cc-5abdf18b4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (f0584826-97c7-4550-b7c9-628e7cb595ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-08eb4afe-712a-4c9a-936c-749cfdb1ef74 tempest-VolumesSnapshotTestJSON-394949413 None] Created volume successfully. Jul 31 07:30:27 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 Jul 31 07:30:27 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:27 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" returned: 0 in 0.497s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:27 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f 1G Jul 31 07:30:27 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:28 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f 1G" returned: 0 in 0.561s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-805e8eeb-aa2e-49d8-92ee-c8517776f54d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:28 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f Jul 31 07:30:28 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-805e8eeb-aa2e-49d8-92ee-c8517776f54d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-805e8eeb-aa2e-49d8-92ee-c8517776f54d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-805e8eeb-aa2e-49d8-92ee-c8517776f54d" acquired by "delete_volume" :: waited 0.036s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d258e06-d97c-466d-8a43-ae84bc9027e7]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:28 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d Jul 31 07:30:28 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:28 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f" returned: 0 in 0.388s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:28 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:30:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:28 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f Jul 31 07:30:28 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:29 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f" returned: 0 in 0.314s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:29 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.info Jul 31 07:30:29 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:29 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d" returned: 0 in 0.654s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:29 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d Jul 31 07:30:29 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:29 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.info" returned: 0 in 0.416s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:29 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:29 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.info Jul 31 07:30:29 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:29 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-805e8eeb-aa2e-49d8-92ee-c8517776f54d" returned: 0 in 0.385s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-805e8eeb-aa2e-49d8-92ee-c8517776f54d" released by "delete_volume" :: held 1.097s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:29 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['5c8b195a-30f0-4ef4-b789-9e22b4abd871', '1e79101a-76f9-4f2d-8b22-07adf6769753', '634693a4-d7a3-41ee-b77c-82a2b4be8fce', 'a4021c82-f4dc-4f85-b39d-973ec8239be6'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:30 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.info" returned: 0 in 0.351s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:30 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:30 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Creating offline snapshot d48ed514-f269-4b15-9912-041ea1044bc9 of volume a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b733a9-80ab-4205-818f-907513c03368]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:30 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 Jul 31 07:30:30 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:30 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.323s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Deleted volume successfully. Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-94026a46-cbd3-447b-9fb2-904956ac472a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-805e8eeb-aa2e-49d8-92ee-c8517776f54d-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:30 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" returned: 0 in 0.586s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:30 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 1G Jul 31 07:30:30 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-64a8f9b3-3d8b-405c-88ec-0b601c407548-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-64a8f9b3-3d8b-405c-88ec-0b601c407548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-8b7b2422-34e0-47c2-b1f3-966c9b5648db" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-8b7b2422-34e0-47c2-b1f3-966c9b5648db" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-64a8f9b3-3d8b-405c-88ec-0b601c407548" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-64a8f9b3-3d8b-405c-88ec-0b601c407548" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Deleting offline snapshot 64a8f9b3-3d8b-405c-88ec-0b601c407548 of volume 8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] snapshot_file for this snap is: volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f170b060-f16d-4bef-bc28-003bc7b6afd3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:31 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 Jul 31 07:30:31 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:31 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 1G" returned: 0 in 0.627s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:31 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 Jul 31 07:30:31 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:31 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548" returned: 0 in 0.512s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bbaa92-5f57-495a-b63c-3f4996f3d7e6]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:31 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9" returned: 0 in 0.442s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:31 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:30:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:31 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 Jul 31 07:30:31 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:31 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db Jul 31 07:30:31 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:32 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:32 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.info Jul 31 07:30:32 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:32 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db" returned: 0 in 0.636s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:32 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 Jul 31 07:30:32 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:32 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.info" returned: 0 in 0.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:32 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:32 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.info Jul 31 07:30:32 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:32 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Flow 'volume_create_manager' (62fd70d8-37fa-440c-be84-de1f3bb320c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3042ab-21cd-4057-a99e-ef1b8749e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548" returned: 0 in 0.471s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3042ab-21cd-4057-a99e-ef1b8749e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2080438028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c6e13b-e643-46ca-a902-34448ce6d357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8576ce9bdd5459792cfd0992e1239d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:33Z,use_quota=True,user_id='0ac1179e69be45bdbe17da00f8793fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:32 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548 Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba0327e-4c54-4e62-903b-3800736108db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:32 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba0327e-4c54-4e62-903b-3800736108db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adc589c-1962-4030-96f5-5d1ce51a1f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adc589c-1962-4030-96f5-5d1ce51a1f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c6e13b-e643-46ca-a902-34448ce6d357', 'volume_name': 'volume-67c6e13b-e643-46ca-a902-34448ce6d357', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8af9f7-32e9-47ec-80d1-901b2ca227e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8af9f7-32e9-47ec-80d1-901b2ca227e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79652696-ef8a-4435-bfb4-4b1d55908e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:32 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Volume 67c6e13b-e643-46ca-a902-34448ce6d357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c6e13b-e643-46ca-a902-34448ce6d357', 'volume_size': 1} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:32 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.info" returned: 0 in 0.316s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.837s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2080438028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c6e13b-e643-46ca-a902-34448ce6d357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8576ce9bdd5459792cfd0992e1239d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:33Z,use_quota=True,user_id='0ac1179e69be45bdbe17da00f8793fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Creating volume 67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:32 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:32 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 1073741824 Jul 31 07:30:32 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-81d82129-e98c-4c2f-9ece-69c647d0d2f3 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot b4dad42a-0103-416b-860c-aa36c5322512: created successfully Jul 31 07:30:33 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db.64a8f9b3-3d8b-405c-88ec-0b601c407548" returned: 0 in 0.290s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-64a8f9b3-3d8b-405c-88ec-0b601c407548" released by "_delete_snapshot" :: held 2.051s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-8b7b2422-34e0-47c2-b1f3-966c9b5648db" released by "delete_snapshot" :: held 2.088s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['d22522b5-5815-48d1-8379-33ad8e263da9', '10dc4e6f-556c-4b5a-a766-f2d17619f637', 'f9281498-49e9-4eba-a517-15427920cf59', '05e7068a-6b16-4781-9abe-9e80338bf24a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Delete snapshot completed successfully. Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c92b72f-2259-4f65-8b8b-76404b03c0c9 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-64a8f9b3-3d8b-405c-88ec-0b601c407548-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:33 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 1073741824" returned: 0 in 0.499s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:33 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:30:33 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:33 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:33 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:33 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.302s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79652696-ef8a-4435-bfb4-4b1d55908e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c6e13b-e643-46ca-a902-34448ce6d357', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9c46f6-0d5e-4147-8d82-b3f1bbc1fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:33 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Volume volume-67c6e13b-e643-46ca-a902-34448ce6d357 (67c6e13b-e643-46ca-a902-34448ce6d357): created successfully Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9c46f6-0d5e-4147-8d82-b3f1bbc1fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Flow 'volume_create_manager' (62fd70d8-37fa-440c-be84-de1f3bb320c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot b4dad42a-0103-416b-860c-aa36c5322512: deleting Jul 31 07:30:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-45e49719-1ad3-4366-9be6-5d4647ddd91e tempest-VolumesActionsTest-478448541 None] Created volume successfully. Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot b4dad42a-0103-416b-860c-aa36c5322512: deleting {{(pid=88915) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-92063511-558e-4974-b6bc-e46f9f88764f" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-92063511-558e-4974-b6bc-e46f9f88764f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Deleting offline snapshot 92063511-558e-4974-b6bc-e46f9f88764f of volume 42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] snapshot_file for this snap is: volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe1052a-86db-40c4-b2ce-6605ce2f187a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:33 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.309s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:30:34 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f Jul 31 07:30:34 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-8b7b2422-34e0-47c2-b1f3-966c9b5648db-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:34 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-8b7b2422-34e0-47c2-b1f3-966c9b5648db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Flow 'volume_create_manager' (e2615358-d911-4d8d-b032-2359515bf9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0e885a-9fb6-4d1e-8838-ed2b0ed21298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f" returned: 0 in 0.474s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0cf580-6463-4675-aafe-def518e5cca3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0e885a-9fb6-4d1e-8838-ed2b0ed21298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1301214039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4827d998-f524-42cb-ac59-a2b3c9399519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d60f89cff164e8c8c60df7d97af4377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:34Z,use_quota=True,user_id='fb9cff6cde8b4b27a0eb6a095f6ccc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1039c952-bc6d-4dc6-83f7-9bb57af3db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1039c952-bc6d-4dc6-83f7-9bb57af3db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d451b32c-53c3-438e-a10f-24f82579369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d451b32c-53c3-438e-a10f-24f82579369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4827d998-f524-42cb-ac59-a2b3c9399519', 'volume_name': 'volume-4827d998-f524-42cb-ac59-a2b3c9399519', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc36ad4-51e2-4c64-93e6-9a1544891c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc36ad4-51e2-4c64-93e6-9a1544891c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd78d41-0904-402b-abf7-059d5a43367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:34 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Volume 4827d998-f524-42cb-ac59-a2b3c9399519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4827d998-f524-42cb-ac59-a2b3c9399519', 'volume_size': 1} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1301214039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4827d998-f524-42cb-ac59-a2b3c9399519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d60f89cff164e8c8c60df7d97af4377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:34Z,use_quota=True,user_id='fb9cff6cde8b4b27a0eb6a095f6ccc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Creating volume 4827d998-f524-42cb-ac59-a2b3c9399519 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:34 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:34 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 1073741824 Jul 31 07:30:34 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-8b7b2422-34e0-47c2-b1f3-966c9b5648db" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-8b7b2422-34e0-47c2-b1f3-966c9b5648db" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:34 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 Jul 31 07:30:34 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e9f2e7-9841-4a30-ad96-d92aa0dc65d1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:34 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db Jul 31 07:30:34 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:34 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" returned: 0 in 0.450s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:34 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f Jul 31 07:30:34 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:35 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db" returned: 0 in 0.392s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:35 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db Jul 31 07:30:35 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:35 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 1073741824" returned: 0 in 0.572s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:35 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 Jul 31 07:30:35 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:35 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b7b2422-34e0-47c2-b1f3-966c9b5648db" returned: 0 in 0.297s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-8b7b2422-34e0-47c2-b1f3-966c9b5648db" released by "delete_volume" :: held 0.772s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:35 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f" returned: 0 in 0.472s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:35 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f Jul 31 07:30:35 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['7b6e5cc1-2917-4bad-bc1a-45f18aeed7a3', '86656a31-53dc-490c-9f2d-325a137dbb07', '0fa3fcf7-9a98-4f9f-87d3-20ef3ce42973', '5b75f1aa-71cd-4d43-b2f2-1fd33c1c9ebc'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:35 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519" returned: 0 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd78d41-0904-402b-abf7-059d5a43367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4827d998-f524-42cb-ac59-a2b3c9399519', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40fa700-5559-4625-bdc2-218b5c539cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:35 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Volume volume-4827d998-f524-42cb-ac59-a2b3c9399519 (4827d998-f524-42cb-ac59-a2b3c9399519): created successfully Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40fa700-5559-4625-bdc2-218b5c539cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:35 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:35 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Flow 'volume_create_manager' (e2615358-d911-4d8d-b032-2359515bf9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3a511c7e-fca4-440c-938a-be0a5bd3c65c tempest-VolumesTransfersV355Test-82747389 None] Created volume successfully. Jul 31 07:30:35 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93.92063511-558e-4974-b6bc-e46f9f88764f" returned: 0 in 0.384s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-92063511-558e-4974-b6bc-e46f9f88764f" released by "_delete_snapshot" :: held 1.890s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" released by "delete_snapshot" :: held 1.915s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-d48ed514-f269-4b15-9912-041ea1044bc9" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-d48ed514-f269-4b15-9912-041ea1044bc9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Deleting offline snapshot d48ed514-f269-4b15-9912-041ea1044bc9 of volume a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:35 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] snapshot_file for this snap is: volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.347s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Deleted volume successfully. Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c64ab-d9ff-4601-8b47-6e039ae9e5ec]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ab7a2832-af19-4e97-b84a-d8c92b20ecf7 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-8b7b2422-34e0-47c2-b1f3-966c9b5648db-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:36 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 Jul 31 07:30:36 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=175,cinder:INSERT=43,cinder:UPDATE=183,cinder:DELETE=12 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (e9e39ab1-96ed-4fb6-a3ae-a5507be4e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc58ba3-ad31-49e8-b7d4-4240f1fc8efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc58ba3-ad31-49e8-b7d4-4240f1fc8efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1279985871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41fbb31-7f7f-4153-8573-0b7873345da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:36Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d095f0bf-dae6-4b46-9afd-4212639de4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d095f0bf-dae6-4b46-9afd-4212639de4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21900542-2cb8-4907-81c0-7b0247261bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21900542-2cb8-4907-81c0-7b0247261bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41fbb31-7f7f-4153-8573-0b7873345da7', 'volume_name': 'volume-d41fbb31-7f7f-4153-8573-0b7873345da7', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7ff11-dca4-4167-9475-92447ca4e308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7ff11-dca4-4167-9475-92447ca4e308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82335873-439e-493a-a76c-3ab0f247fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:36 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Volume d41fbb31-7f7f-4153-8573-0b7873345da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41fbb31-7f7f-4153-8573-0b7873345da7', 'volume_size': 1} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1279985871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41fbb31-7f7f-4153-8573-0b7873345da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:36Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Creating volume d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:36 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:36 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9" returned: 0 in 0.575s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:36 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 1073741824 Jul 31 07:30:36 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f9828-deac-40f5-8248-2208fda57315]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:36 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 Jul 31 07:30:36 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:37 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 1073741824" returned: 0 in 0.607s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:37 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" returned: 0 in 0.583s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:37 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 Jul 31 07:30:37 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:37 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 Jul 31 07:30:37 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d166b9a2-b671-4d57-8a0c-ff579cce974f tempest-VolumesTransfersV355Test-1047621665 None] Transfer volume completed successfully. Jul 31 07:30:37 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82335873-439e-493a-a76c-3ab0f247fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41fbb31-7f7f-4153-8573-0b7873345da7', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2312137d-6dbe-44a4-93be-ef42253ccb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:37 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Volume volume-d41fbb31-7f7f-4153-8573-0b7873345da7 (d41fbb31-7f7f-4153-8573-0b7873345da7): created successfully Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2312137d-6dbe-44a4-93be-ef42253ccb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (e9e39ab1-96ed-4fb6-a3ae-a5507be4e011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c205e15f-0fa2-4e62-ab38-33734851f14f tempest-VolumesSnapshotTestJSON-394949413 None] Created volume successfully. Jul 31 07:30:37 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9" returned: 0 in 0.578s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:37 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9 Jul 31 07:30:37 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Acquiring lock "cinder-4827d998-f524-42cb-ac59-a2b3c9399519-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-4827d998-f524-42cb-ac59-a2b3c9399519-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Acquiring lock "cinder-quobyte-4827d998-f524-42cb-ac59-a2b3c9399519" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:38 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5.d48ed514-f269-4b15-9912-041ea1044bc9" returned: 0 in 0.420s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-quobyte-4827d998-f524-42cb-ac59-a2b3c9399519" acquired by "delete_volume" :: waited 0.052s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-d48ed514-f269-4b15-9912-041ea1044bc9" released by "_delete_snapshot" :: held 2.332s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" released by "delete_snapshot" :: held 2.369s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf5a442-b54e-4fdb-a366-6f788decc3d9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:38 devstack cinder-volume[88915]: WARNING cinder.quota [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1798645697 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1798645697, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:30:38 devstack cinder-volume[88915]: WARNING cinder.quota [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1798645697 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1798645697, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['ddd608e3-a8bc-4db5-994a-73682d6a9340', 'd44daa22-4e28-4302-be52-45850556863f', '31b8f3e4-a4f6-4f24-97bd-0c208baab2ed', 'bcceeadd-1c93-4dba-b568-40d5da5153ae'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:38 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 Jul 31 07:30:38 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['fa9dba58-00cb-4398-9234-a793ea4ad9a8', '2171a85d-446c-409b-a35d-23eade13ea5d', '115f89a7-c900-4f3b-ab52-1c951211fc6f', 'c4ecc6e6-6395-402e-9b3c-f711f072625d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:38 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519" returned: 0 in 0.553s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:38 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519 Jul 31 07:30:38 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:38 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-291a7b55-3107-4ccd-a19b-780e5b339f81 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot b4dad42a-0103-416b-860c-aa36c5322512: deleted successfully Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Creating offline snapshot 1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 of volume d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b9b4d-372b-4ee1-96f1-da8041d378f1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:39 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 Jul 31 07:30:39 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:39 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4827d998-f524-42cb-ac59-a2b3c9399519" returned: 0 in 0.299s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-quobyte-4827d998-f524-42cb-ac59-a2b3c9399519" released by "delete_volume" :: held 0.911s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Created reservations ['dffa8c28-3afa-4b88-b301-1e590e990738', 'e9b183e8-d0e9-4361-b303-38306d0199f9', '319e60ce-fd46-43c7-a015-80a3d630d58e', '39e2f120-682c-485c-b0c4-700faeb8dfbc'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:39 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:39 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:39 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7" returned: 0 in 0.504s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:39 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 1G Jul 31 07:30:39 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:39 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.368s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:39 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Deleted volume successfully. Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=169,cinder:INSERT=46,cinder:UPDATE=185,cinder:DELETE=15 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:30:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734d8c4e-7d7d-4dc9-a8a6-dbc0e1ee5efa tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-4827d998-f524-42cb-ac59-a2b3c9399519-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:40 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 1G" returned: 0 in 0.624s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41fbb31-7f7f-4153-8573-0b7873345da7 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" acquired by "delete_volume" :: waited 0.048s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:40 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41fbb31-7f7f-4153-8573-0b7873345da7 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 Jul 31 07:30:40 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fa4ed8-ac67-4e0b-b265-8d9a6907f068]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Flow 'volume_create_manager' (1feb0460-8875-4846-8e71-c078ae146bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6ff717-bf22-43ed-82be-e7a4e1ffae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6ff717-bf22-43ed-82be-e7a4e1ffae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1801479982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4292aa-c127-46ac-bde9-305973fab422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d60f89cff164e8c8c60df7d97af4377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:40Z,use_quota=True,user_id='fb9cff6cde8b4b27a0eb6a095f6ccc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc34320-207a-499e-92c2-32e9afadf4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc34320-207a-499e-92c2-32e9afadf4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:40 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 Jul 31 07:30:40 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195f727e-33ff-476b-9a45-d47f279da524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195f727e-33ff-476b-9a45-d47f279da524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4292aa-c127-46ac-bde9-305973fab422', 'volume_name': 'volume-3c4292aa-c127-46ac-bde9-305973fab422', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9d931f-510d-43d1-baf0-13630a1a1b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9d931f-510d-43d1-baf0-13630a1a1b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f432329f-5b60-44a0-8daf-5125024b09c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:40 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Volume 3c4292aa-c127-46ac-bde9-305973fab422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4292aa-c127-46ac-bde9-305973fab422', 'volume_size': 1} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:40 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41fbb31-7f7f-4153-8573-0b7873345da7 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" returned: 0 in 0.400s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:40 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 is being set with open permissions: ugo+rw Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:40 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 Jul 31 07:30:40 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:40 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" returned: 0 in 0.473s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:40 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93 Jul 31 07:30:40 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:40 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" returned: 0 in 0.314s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:40 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.info Jul 31 07:30:40 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:40 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" returned: 0 in 0.339s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-42a54b72-1d00-4395-b6f0-0ebc5ab8ab93" released by "delete_volume" :: held 0.913s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a281ea6-1c48-47b1-9c39-618851922f0a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:41 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.info" returned: 0 in 0.579s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:41 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.info is being set with open permissions: ugo+rw Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:41 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 Jul 31 07:30:41 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:41 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.info Jul 31 07:30:41 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:41 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:41 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.info" returned: 0 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1801479982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4292aa-c127-46ac-bde9-305973fab422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d60f89cff164e8c8c60df7d97af4377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:40Z,use_quota=True,user_id='fb9cff6cde8b4b27a0eb6a095f6ccc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Creating volume 3c4292aa-c127-46ac-bde9-305973fab422 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:41 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" returned: 0 in 0.741s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:41 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 1073741824 Jul 31 07:30:41 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:41 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c3fed083-9a95-4f84-9d57-5e293faea10b tempest-VolumesSnapshotTestJSON-394949413 None] Create snapshot completed successfully Jul 31 07:30:42 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5 Jul 31 07:30:42 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:42 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" returned: 0 in 0.501s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-a9ab3cbe-791e-4dfb-9ba1-cd486dff3cc5" released by "delete_volume" :: held 1.423s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:42 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 1073741824" returned: 0 in 0.699s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:42 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['bc36b296-6bcf-4018-801d-a5111f9843c5'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:42 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 Jul 31 07:30:42 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:42 devstack cinder-volume[88915]: WARNING cinder.quota [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1798645697 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1798645697, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:30:42 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['e14440e6-4bad-4125-993e-1dfdb624e56b', 'fae06b33-3e88-464e-95be-5cdf01e8c65d', '36deed77-eb72-40de-ae86-1f113138b9cd', '9cf29176-2384-45a5-a45f-bca985df6316'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:42 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['1f97367a-b1bc-4d1f-a12b-b48b242cf008', '7a34fe8b-14ae-45c0-8ecd-b40f87afa61d', '513ab103-6792-40ce-b3d2-306443a9215d', 'cb2456eb-297b-44a4-8f75-2d68a6262889'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (576f51dc-c8a3-4c61-8d22-e7d493dab804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae95553-cba3-4791-a8ce-55ccd6038525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:43 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422" returned: 0 in 0.391s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae95553-cba3-4791-a8ce-55ccd6038525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2017240111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5304b58b-48db-4315-bd66-334c17dcebbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a712d7b39940b79c655178b032720b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:43Z,use_quota=True,user_id='17cefa082fb7453ba8fbbe2d53c47bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f246d35b-d551-43e1-918e-f0c9ff3d6b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f246d35b-d551-43e1-918e-f0c9ff3d6b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2000757-b77e-460d-9499-ae98ccde1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2000757-b77e-460d-9499-ae98ccde1db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5304b58b-48db-4315-bd66-334c17dcebbb', 'volume_name': 'volume-5304b58b-48db-4315-bd66-334c17dcebbb', 'volume_size': 1, 'snapshot_id': '1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4f4c83-1fa9-43d4-b6a0-3e2feb29435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4f4c83-1fa9-43d4-b6a0-3e2feb29435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5736df-ff95-4a11-8ac3-f09d10548890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:43 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Volume 5304b58b-48db-4315-bd66-334c17dcebbb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5304b58b-48db-4315-bd66-334c17dcebbb', 'volume_size': 1, 'snapshot_id': '1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8'} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f432329f-5b60-44a0-8daf-5125024b09c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4292aa-c127-46ac-bde9-305973fab422', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9d149a-684d-4b68-a7fd-4b39c21f726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8-5304b58b-48db-4315-bd66-334c17dcebbb" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:43 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Volume volume-3c4292aa-c127-46ac-bde9-305973fab422 (3c4292aa-c127-46ac-bde9-305973fab422): created successfully Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9d149a-684d-4b68-a7fd-4b39c21f726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Flow 'volume_create_manager' (1feb0460-8875-4846-8e71-c078ae146bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8-5304b58b-48db-4315-bd66-334c17dcebbb" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Creating volume 5304b58b-48db-4315-bd66-334c17dcebbb from snapshot 1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-5304b58b-48db-4315-bd66-334c17dcebbb" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:43 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4d9c1183-ba5e-49a8-bc66-95dd1b51f1d3 tempest-VolumesTransfersV355Test-82747389 None] Created volume successfully. Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-5304b58b-48db-4315-bd66-334c17dcebbb" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] snapshot: 1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8, volume: 5304b58b-48db-4315-bd66-334c17dcebbb, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:30:43 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:43 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df741d-66a5-4db0-a969-5a71bace7239]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:43 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 Jul 31 07:30:43 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:43 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.293s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:43 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-57360431-2a9b-4805-8ed3-47c2b604da9d tempest-GroupSnapshotsTest-1145442677 None] Delete group completed successfully. Jul 31 07:30:43 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" returned: 0 in 0.447s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d41fbb31-7f7f-4153-8573-0b7873345da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a58d94b-89c6-40ad-95b0-3a2f204ec24f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Acquiring lock "cinder-3c4292aa-c127-46ac-bde9-305973fab422-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-3c4292aa-c127-46ac-bde9-305973fab422-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:44 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 Jul 31 07:30:44 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Acquiring lock "cinder-quobyte-3c4292aa-c127-46ac-bde9-305973fab422" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-quobyte-3c4292aa-c127-46ac-bde9-305973fab422" acquired by "delete_volume" :: waited 0.101s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36d25c0-513f-4b79-ad14-34177c45d7ae]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:44 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7" returned: 0 in 0.701s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:44 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 Jul 31 07:30:44 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:44 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb Jul 31 07:30:44 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3ea052ca-7bbc-4055-8275-c485e15fa471 tempest-GroupSnapshotsTest-1145442677 None] Group tempest-GroupSnapshotsTest-Group-298407995: creating Jul 31 07:30:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3ea052ca-7bbc-4055-8275-c485e15fa471 tempest-GroupSnapshotsTest-1145442677 None] Group tempest-GroupSnapshotsTest-Group-298407995: created successfully Jul 31 07:30:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3ea052ca-7bbc-4055-8275-c485e15fa471 tempest-GroupSnapshotsTest-1145442677 None] Create group completed successfully. Jul 31 07:30:44 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422" returned: 0 in 0.472s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:44 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422 Jul 31 07:30:44 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:45 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c4292aa-c127-46ac-bde9-305973fab422" returned: 0 in 0.306s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-quobyte-3c4292aa-c127-46ac-bde9-305973fab422" released by "delete_volume" :: held 0.870s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Created reservations ['acd602cb-4dae-4e9c-b160-1b1d0c2be1b7', '79012983-6442-407b-a583-29d1c244017d', '2f0b7aea-c2a0-44a3-a8a7-dca502a7a025', '020bc036-acb3-4183-8cac-88277747d3ee'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d48b5454-38e9-452c-8bfe-5c15eda4cb78 tempest-VolumesActionsTest-478448541 None] Acquiring lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357" by "attach_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d48b5454-38e9-452c-8bfe-5c15eda4cb78 tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357" acquired by "attach_volume" :: waited 0.053s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:45 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:45 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d48b5454-38e9-452c-8bfe-5c15eda4cb78 tempest-VolumesActionsTest-478448541 None] Attaching volume 67c6e13b-e643-46ca-a902-34448ce6d357 to instance 069af91d-35a4-400c-99b7-4d992ca23af4 at mountpoint /dev/vdb on host None. Jul 31 07:30:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d48b5454-38e9-452c-8bfe-5c15eda4cb78 tempest-VolumesActionsTest-478448541 None] Attach volume completed successfully. Jul 31 07:30:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d48b5454-38e9-452c-8bfe-5c15eda4cb78 tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357" released by "attach_volume" :: held 0.449s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:46 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.796s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:46 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Deleted volume successfully. Jul 31 07:30:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51af931a-6e67-49b6-9ae1-07d4c3a5881e tempest-VolumesActionsTest-478448541 None] Acquiring lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-detach_volume" by "detach_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40b5013-144d-4d48-a376-62a7b27bfb3f tempest-VolumesTransfersV355Test-1867956626 None] Lock "cinder-3c4292aa-c127-46ac-bde9-305973fab422-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51af931a-6e67-49b6-9ae1-07d4c3a5881e tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-detach_volume" acquired by "detach_volume" :: waited 0.089s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-51af931a-6e67-49b6-9ae1-07d4c3a5881e tempest-VolumesActionsTest-478448541 None] Detaching volume 67c6e13b-e643-46ca-a902-34448ce6d357 from instance 069af91d-35a4-400c-99b7-4d992ca23af4. Jul 31 07:30:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-51af931a-6e67-49b6-9ae1-07d4c3a5881e tempest-VolumesActionsTest-478448541 None] Detach volume completed successfully. Jul 31 07:30:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51af931a-6e67-49b6-9ae1-07d4c3a5881e tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-detach_volume" released by "detach_volume" :: held 0.296s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (e4bd7f8c-6992-4190-8554-a1d12213d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9d67bd-6d83-4ba9-84d4-3235b1812173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9d67bd-6d83-4ba9-84d4-3235b1812173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1746954355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22339518-061e-4c66-863f-92876db6af4d,host='devstack@QuobyteHD#QuobyteHD',id=38575f3c-71b5-4883-8395-372649605806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:48Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec871d3c-ab1a-4c2f-8ca4-0e34bdf91a34),volume_type_id=ec871d3c-ab1a-4c2f-8ca4-0e34bdf91a34)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f341d68b-07fd-4613-b8fa-b6527c7b3049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f341d68b-07fd-4613-b8fa-b6527c7b3049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff2406-cd5a-487b-8345-07469dbf2872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff2406-cd5a-487b-8345-07469dbf2872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38575f3c-71b5-4883-8395-372649605806', 'volume_name': 'volume-38575f3c-71b5-4883-8395-372649605806', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f717eb2-eb75-494f-8070-a61b6d69227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f717eb2-eb75-494f-8070-a61b6d69227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620940aa-63cb-4dc8-af31-e3783683c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:48 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Volume 38575f3c-71b5-4883-8395-372649605806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38575f3c-71b5-4883-8395-372649605806', 'volume_size': 1} Jul 31 07:30:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:51 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb" returned: 0 in 7.247s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:51 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb24e5d9-788e-4c33-81b1-b9f7964d12aa]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:51 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 Jul 31 07:30:51 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:52 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7" returned: 0 in 0.597s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:30:52 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Converted 1024.00 MB image at 141.27 MB/s Jul 31 07:30:52 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb is being set with open permissions: ugo+rw Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:52 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb Jul 31 07:30:52 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:52 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb" returned: 0 in 0.359s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-5304b58b-48db-4315-bd66-334c17dcebbb" released by "_copy_volume_from_snapshot" :: held 9.501s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8-5304b58b-48db-4315-bd66-334c17dcebbb" released by "_create_volume_from_snapshot" :: held 9.564s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.596s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.378s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22339518-061e-4c66-863f-92876db6af4d,created_at=2026-07-31T05:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1746954355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22339518-061e-4c66-863f-92876db6af4d,host='devstack@QuobyteHD#QuobyteHD',id=38575f3c-71b5-4883-8395-372649605806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a22e972d8e0e41008113e24a002b8f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:48Z,use_quota=True,user_id='7c26b81be539481e9df7e3a6141bc676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec871d3c-ab1a-4c2f-8ca4-0e34bdf91a34),volume_type_id=ec871d3c-ab1a-4c2f-8ca4-0e34bdf91a34)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Creating volume 38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:52 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:52 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 1073741824 Jul 31 07:30:52 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5736df-ff95-4a11-8ac3-f09d10548890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5304b58b-48db-4315-bd66-334c17dcebbb', 'volume_size': 1, 'snapshot_id': '1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e669d489-d6c1-4af2-ac92-f1e2add8a44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:52 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Volume volume-5304b58b-48db-4315-bd66-334c17dcebbb (5304b58b-48db-4315-bd66-334c17dcebbb): created successfully Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e669d489-d6c1-4af2-ac92-f1e2add8a44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Flow 'volume_create_manager' (576f51dc-c8a3-4c61-8d22-e7d493dab804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:52 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cf592d1a-39ae-418a-b88e-a2c75678d0c0 tempest-VolumesSnapshotTestJSON-394949413 None] Created volume successfully. Jul 31 07:30:53 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 1073741824" returned: 0 in 0.550s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:53 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 Jul 31 07:30:53 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:53 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806" returned: 0 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620940aa-63cb-4dc8-af31-e3783683c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38575f3c-71b5-4883-8395-372649605806', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a46e54-f336-4b23-9f28-dff2c386afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:53 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Volume volume-38575f3c-71b5-4883-8395-372649605806 (38575f3c-71b5-4883-8395-372649605806): created successfully Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a46e54-f336-4b23-9f28-dff2c386afbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Flow 'volume_create_manager' (e4bd7f8c-6992-4190-8554-a1d12213d783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-57e8aa09-a01a-435d-a9af-5eaf5687b096 tempest-GroupSnapshotsTest-1145442677 None] Created volume successfully. Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-5304b58b-48db-4315-bd66-334c17dcebbb-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-5304b58b-48db-4315-bd66-334c17dcebbb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-5304b58b-48db-4315-bd66-334c17dcebbb" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-5304b58b-48db-4315-bd66-334c17dcebbb" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce112b58-2ce2-49c9-987c-f2beb6af67d3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:54 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb Jul 31 07:30:54 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:54 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb" returned: 0 in 0.493s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:54 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb Jul 31 07:30:54 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:55 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5304b58b-48db-4315-bd66-334c17dcebbb" returned: 0 in 0.434s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-5304b58b-48db-4315-bd66-334c17dcebbb" released by "delete_volume" :: held 0.996s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] GroupSnapshot 0b490d40-94b5-4433-85e4-85da78af9b2e: creating. Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['7781c32c-d849-41f3-afa3-6c6d0fdd9670', 'becacd04-8923-47cd-859b-d65fb66465c8', '8b2c7a51-c7e2-420f-804c-46c30abcd430', '2ab3b675-9b93-4a46-b800-474a8badd471'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Group snapshot 0b490d40-94b5-4433-85e4-85da78af9b2e: creating. {{(pid=88915) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Creating offline snapshot e4f602dd-a7d9-41b1-b6d7-17c5642ca372 of volume 38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d2adf7-7c8f-4c31-875e-29727117ce0f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:55 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:30:55 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:55 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 Jul 31 07:30:55 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:55 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.487s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:30:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Deleted volume successfully. Jul 31 07:30:55 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806" returned: 0 in 0.606s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d2beb41e-c7a0-4d6d-b344-16de79c4ab7a tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-5304b58b-48db-4315-bd66-334c17dcebbb-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:56 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 1G Jul 31 07:30:56 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-d41fbb31-7f7f-4153-8573-0b7873345da7" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-d41fbb31-7f7f-4153-8573-0b7873345da7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Deleting offline snapshot 1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 of volume d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] snapshot_file for this snap is: volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f173ff7-f64a-45c8-9b36-fda60b4fa276]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:56 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 1G" returned: 0 in 0.630s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38575f3c-71b5-4883-8395-372649605806 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:56 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38575f3c-71b5-4883-8395-372649605806 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 Jul 31 07:30:56 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:56 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 Jul 31 07:30:56 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:56 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38575f3c-71b5-4883-8395-372649605806 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372" returned: 0 in 0.348s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:56 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:56 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" returned: 0 in 0.459s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d41fbb31-7f7f-4153-8573-0b7873345da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:56 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 Jul 31 07:30:56 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e685d337-4f59-4162-b8ba-e30f152eb6b1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:57 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 Jul 31 07:30:57 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:57 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372" returned: 0 in 0.343s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:57 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.info Jul 31 07:30:57 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:57 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7" returned: 0 in 0.535s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:57 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 Jul 31 07:30:57 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:57 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.info" returned: 0 in 0.353s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:57 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:57 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.info Jul 31 07:30:57 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:57 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" returned: 0 in 0.387s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:57 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8 Jul 31 07:30:57 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:58 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.info" returned: 0 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:30:58 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Flow 'volume_create_manager' (6fd75286-545e-4a67-aec9-15d423f9df74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afe848b-4946-444b-9d0a-9bb448d53bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-32e908ae-89db-49b9-958b-b672837e738b tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 0b490d40-94b5-4433-85e4-85da78af9b2e: created successfully Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7.1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" returned: 0 in 0.565s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afe848b-4946-444b-9d0a-9bb448d53bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1714144742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1e9ca87e4e4f2089f389aeef0ca118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:58Z,use_quota=True,user_id='2e024d97ebde4ad1aefc4a876e5bdc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30798b7f-542e-4301-9958-14a6875fa4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30798b7f-542e-4301-9958-14a6875fa4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130b7d7d-b549-42ca-a34d-e9428ad15704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130b7d7d-b549-42ca-a34d-e9428ad15704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2', 'volume_name': 'volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7331062-dca5-452d-9e04-e450a3e1dd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7331062-dca5-452d-9e04-e450a3e1dd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e1a1e8-7fc7-4c2c-b589-279a54998b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:30:58 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Volume b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2', 'volume_size': 1} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1714144742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1e9ca87e4e4f2089f389aeef0ca118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:30:58Z,use_quota=True,user_id='2e024d97ebde4ad1aefc4a876e5bdc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Creating volume b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:30:58 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:58 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 1073741824 Jul 31 07:30:58 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8" released by "_delete_snapshot" :: held 2.380s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-d41fbb31-7f7f-4153-8573-0b7873345da7" released by "delete_snapshot" :: held 2.456s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['ce642d30-5bbf-4473-84ca-09b423d7d8cd', '7f3871f5-7e6d-4f44-bf9a-e221fa9cb806', '37b45321-81f7-4b6c-b81a-3ace845d732c', '7faec631-fc2b-4cac-832c-6c68aaf285dd'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:30:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 0b490d40-94b5-4433-85e4-85da78af9b2e: deleting Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 0b490d40-94b5-4433-85e4-85da78af9b2e: deleting {{(pid=88915) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-38575f3c-71b5-4883-8395-372649605806" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-38575f3c-71b5-4883-8395-372649605806" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-e4f602dd-a7d9-41b1-b6d7-17c5642ca372" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Delete snapshot completed successfully. Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-e4f602dd-a7d9-41b1-b6d7-17c5642ca372" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Deleting offline snapshot e4f602dd-a7d9-41b1-b6d7-17c5642ca372 of volume 38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] snapshot_file for this snap is: volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f6001c85-2a98-4c28-9e64-2c5dde7f4433 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-1c236e8c-6c4d-4df8-bbcf-3ed800a42dd8-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2098aa25-52ba-41c1-a119-b5a7690c56f6]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:59 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 1073741824" returned: 0 in 0.819s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:59 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 Jul 31 07:30:59 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:59 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 Jul 31 07:30:59 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-d41fbb31-7f7f-4153-8573-0b7873345da7-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-d41fbb31-7f7f-4153-8573-0b7873345da7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:59 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372" returned: 0 in 0.561s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38575f3c-71b5-4883-8395-372649605806(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-d41fbb31-7f7f-4153-8573-0b7873345da7" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:30:59 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-d41fbb31-7f7f-4153-8573-0b7873345da7" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[006fb4b1-0e3b-445a-a78b-e65afb2c63ea]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" returned: 0 in 0.401s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d8acaa-a9eb-4254-9524-614c70b3742c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:30:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e1a1e8-7fc7-4c2c-b589-279a54998b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d642fc4a-3f5b-48d6-ae89-afbe527241d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:00 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Volume volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 (b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2): created successfully Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d642fc4a-3f5b-48d6-ae89-afbe527241d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Flow 'volume_create_manager' (6fd75286-545e-4a67-aec9-15d423f9df74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:00 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-264ce05f-2342-4884-8203-78fd539d10b5 tempest-VolumesCloneTest-454155061 None] Created volume successfully. Jul 31 07:31:00 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 Jul 31 07:31:00 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:00 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 Jul 31 07:31:00 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:00 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806" returned: 0 in 0.469s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:00 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 Jul 31 07:31:00 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:00 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7" returned: 0 in 0.538s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:00 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7 Jul 31 07:31:00 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:00 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:00 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d41fbb31-7f7f-4153-8573-0b7873345da7" returned: 0 in 0.460s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372" returned: 0 in 0.579s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-d41fbb31-7f7f-4153-8573-0b7873345da7" released by "delete_volume" :: held 1.130s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:01 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372 Jul 31 07:31:01 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Flow 'volume_create_manager' (421c537b-1c9f-48a4-b89f-f7ba6fab7019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b21e637-4a9b-4390-860d-408fe3051714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b21e637-4a9b-4390-860d-408fe3051714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-386865595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c115e6fb-0ed1-4821-9999-5d3d4a5feadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1e9ca87e4e4f2089f389aeef0ca118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:01Z,use_quota=True,user_id='2e024d97ebde4ad1aefc4a876e5bdc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318be5d8-a243-422f-afd6-09b76a802567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318be5d8-a243-422f-afd6-09b76a802567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50811eb5-36ce-44a4-b4be-ab603882c92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50811eb5-36ce-44a4-b4be-ab603882c92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c115e6fb-0ed1-4821-9999-5d3d4a5feadd', 'volume_name': 'volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd', 'volume_size': 2, 'source_volid': 'b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2', 'source_volstatus': 'available'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3858a9-8a65-468c-8313-76716050caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3858a9-8a65-468c-8313-76716050caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e8604f-9b7c-4ad0-81a7-1930ec4b04f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:01 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Volume c115e6fb-0ed1-4821-9999-5d3d4a5feadd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd', 'volume_size': 2, 'source_volid': 'b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2', 'source_volstatus': 'available'} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['29123a45-85c8-4acc-b2a0-c6bd172a54e2', '32bb964f-9ae7-4b5d-8041-39baf8310d49', '4c9b29fe-509b-42d4-a079-708afd88bf5d', '97a1c0c0-63bf-4d83-9276-43ac3956b42f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:01 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Cloning volume b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 to volume c115e6fb-0ed1-4821-9999-5d3d4a5feadd Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Creating offline snapshot 4139d733-ad2f-4797-b116-852bceb2ceac of volume b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0b258-2aaf-4fe6-b916-f5327bcab933]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:01 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806.e4f602dd-a7d9-41b1-b6d7-17c5642ca372" returned: 0 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-e4f602dd-a7d9-41b1-b6d7-17c5642ca372" released by "_delete_snapshot" :: held 2.209s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-38575f3c-71b5-4883-8395-372649605806" released by "delete_snapshot" :: held 2.287s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:01 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 Jul 31 07:31:01 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:01 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:31:01 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:01 devstack cinder-volume[88915]: WARNING cinder.quota [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-570345964 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-570345964, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:31:01 devstack cinder-volume[88915]: WARNING cinder.quota [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-570345964 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-570345964, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['2b2fcf8a-fd48-4a9c-a7a7-01cd77d4ce2b', '30df2aab-8f16-4b57-bbc9-62be6bc78991', '6d2d2cfa-6a40-4558-91ae-e6b0dcbd593b', 'ce0ce133-c764-4243-8ba1-23f52b1d94a3'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:01 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-36ab00e7-51f7-493f-9b87-a00314697b81 tempest-GroupSnapshotsTest-1145442677 None] group_snapshot 0b490d40-94b5-4433-85e4-85da78af9b2e: deleted successfully Jul 31 07:31:01 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" returned: 0 in 0.542s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:01 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.433s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:01 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:31:01 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Deleted volume successfully. Jul 31 07:31:01 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac 1G Jul 31 07:31:01 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f0fcfccf-6c4a-4399-a9b3-d75d261bea1e tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-d41fbb31-7f7f-4153-8573-0b7873345da7-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6e3b8575-0349-4048-91eb-79d47e555f67 tempest-VolumesActionsTest-478448541 None] Acquiring lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357" by "attach_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6e3b8575-0349-4048-91eb-79d47e555f67 tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357" acquired by "attach_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6e3b8575-0349-4048-91eb-79d47e555f67 tempest-VolumesActionsTest-478448541 None] Attaching volume 67c6e13b-e643-46ca-a902-34448ce6d357 to instance 117c63e8-cb70-4281-bd5e-b8486f5da8a8 at mountpoint /dev/vdb on host None. Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-677b4db6-cfd8-456e-9d5b-8a9e52683320-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6e3b8575-0349-4048-91eb-79d47e555f67 tempest-VolumesActionsTest-478448541 None] Attach volume completed successfully. Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6e3b8575-0349-4048-91eb-79d47e555f67 tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357" released by "attach_volume" :: held 0.155s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-677b4db6-cfd8-456e-9d5b-8a9e52683320-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "cinder-quobyte-677b4db6-cfd8-456e-9d5b-8a9e52683320" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-677b4db6-cfd8-456e-9d5b-8a9e52683320" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d5ed14-6507-4d19-b6ba-c572efd2f5b7]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8ce1dd3-2c67-480f-8f1e-f9e22275c09d tempest-VolumesActionsTest-478448541 None] Acquiring lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-detach_volume" by "detach_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:02 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac 1G" returned: 0 in 0.615s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:02 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 Jul 31 07:31:02 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:02 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8ce1dd3-2c67-480f-8f1e-f9e22275c09d tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-detach_volume" acquired by "detach_volume" :: waited 0.072s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b8ce1dd3-2c67-480f-8f1e-f9e22275c09d tempest-VolumesActionsTest-478448541 None] Detaching volume 67c6e13b-e643-46ca-a902-34448ce6d357 from instance 117c63e8-cb70-4281-bd5e-b8486f5da8a8. Jul 31 07:31:02 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b8ce1dd3-2c67-480f-8f1e-f9e22275c09d tempest-VolumesActionsTest-478448541 None] Detach volume completed successfully. Jul 31 07:31:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b8ce1dd3-2c67-480f-8f1e-f9e22275c09d tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:03 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320" returned: 0 in 0.602s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:03 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac" returned: 0 in 0.481s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:03 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac is being set with open permissions: ugo+rw Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:03 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320 Jul 31 07:31:03 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:03 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac Jul 31 07:31:03 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "cinder-quobyte-38575f3c-71b5-4883-8395-372649605806" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-38575f3c-71b5-4883-8395-372649605806" acquired by "delete_volume" :: waited 0.037s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b349d-dbdf-4001-a173-3ef91c0afb60]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:03 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-677b4db6-cfd8-456e-9d5b-8a9e52683320" returned: 0 in 0.472s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-quobyte-677b4db6-cfd8-456e-9d5b-8a9e52683320" released by "delete_volume" :: held 1.184s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:03 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac" returned: 0 in 0.510s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:03 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.info Jul 31 07:31:03 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 Jul 31 07:31:03 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:03 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Created reservations ['76c955a4-4114-4dce-a378-ad94c9df4e9d', 'cc296ff5-f002-4c9a-a006-a3ce34ad48e7', '8e1b931e-390a-4777-a1bd-5fc9c908ac81', 'a0871a69-a959-47d5-86df-d5cbf8b40881'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:04 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:04 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.info" returned: 0 in 0.395s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:04 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:04 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.info is being set with open permissions: ugo+rw Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:04 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.info Jul 31 07:31:04 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:04 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806" returned: 0 in 0.687s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:04 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806 Jul 31 07:31:04 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:04 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.info" returned: 0 in 0.339s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:04 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Acquiring lock "cinder-quobyte-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.469s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:31:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Deleted volume successfully. Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] snapshot: 4139d733-ad2f-4797-b116-852bceb2ceac, volume: c115e6fb-0ed1-4821-9999-5d3d4a5feadd, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-663b999e-e5c7-4055-a4b0-28709cada518 tempest-VolumesSnapshotTestJSON-394949413 None] Lock "cinder-677b4db6-cfd8-456e-9d5b-8a9e52683320-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d30b2ad-47a0-409b-9fc6-877bc3f26a9e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:04 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-38575f3c-71b5-4883-8395-372649605806" returned: 0 in 0.351s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Lock "cinder-quobyte-38575f3c-71b5-4883-8395-372649605806" released by "delete_volume" :: held 1.161s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:04 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac Jul 31 07:31:04 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['ca587ca0-4c58-465c-9895-ab0c1ebcca07'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:04 devstack cinder-volume[88915]: WARNING cinder.quota [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-570345964 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-570345964, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Created reservations ['a14b3ade-cb3f-4513-955d-f4e0eb6e4857', '1dd18e84-8a6b-4d9b-866d-abd82af05419', '7fe21f14-a813-4b1c-84bf-d461df138907', 'cd5f69c1-139d-4624-92ba-fed0a21d8fda'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:04 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:31:04 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:05 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac" returned: 0 in 0.551s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dd24ba-77b4-4604-9caf-5dd57aa28492]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:05 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 Jul 31 07:31:05 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:05 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.409s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:31:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-19abdfac-30ea-4705-aa6d-d05b5ab473b5 tempest-GroupSnapshotsTest-1145442677 None] Delete group completed successfully. Jul 31 07:31:05 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" returned: 0 in 0.539s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:31:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:05 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd Jul 31 07:31:05 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:11 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" returned: 0 in 6.109s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:11 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd53e6c-738e-42b9-a16b-7b474d8064dc]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:11 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 Jul 31 07:31:11 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:12 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" returned: 0 in 0.649s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:31:12 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Converted 1024.00 MB image at 167.59 MB/s Jul 31 07:31:12 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd is being set with open permissions: ugo+rw Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:12 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd Jul 31 07:31:12 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:12 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" returned: 0 in 0.297s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" released by "_copy_volume_from_snapshot" :: held 8.264s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Acquiring lock "cinder-quobyte-4139d733-ad2f-4797-b116-852bceb2ceac" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-4139d733-ad2f-4797-b116-852bceb2ceac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Deleting offline snapshot 4139d733-ad2f-4797-b116-852bceb2ceac of volume b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] snapshot_file for this snap is: volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a2ab41-9060-42ee-9e78-9a8f12c45767]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:12 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac Jul 31 07:31:12 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:13 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac" returned: 0 in 0.422s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:31:13 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[160f6cfe-b429-49ea-b20e-a08b831ca999]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:13 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 Jul 31 07:31:13 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:13 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" returned: 0 in 0.419s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:13 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac Jul 31 07:31:13 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:14 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac" returned: 0 in 0.368s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:14 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac Jul 31 07:31:14 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:14 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2.4139d733-ad2f-4797-b116-852bceb2ceac" returned: 0 in 0.252s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-4139d733-ad2f-4797-b116-852bceb2ceac" released by "_delete_snapshot" :: held 1.569s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.157s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e8604f-9b7c-4ad0-81a7-1930ec4b04f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd', 'volume_size': 2, 'source_volid': 'b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2', 'source_volstatus': 'available'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb8ef42-98de-4f3a-9a0c-e26d9ee51094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7264667-6be1-41d6-bb75-447565880bdd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Volume volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd (c115e6fb-0ed1-4821-9999-5d3d4a5feadd): created successfully Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb8ef42-98de-4f3a-9a0c-e26d9ee51094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Flow 'volume_create_manager' (421c537b-1c9f-48a4-b89f-f7ba6fab7019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-767f3031-1fc8-4d87-b19f-f3e2739f40b2 tempest-VolumesCloneTest-454155061 None] Created volume successfully. Jul 31 07:31:14 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:14 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:14 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb34ef1-d560-4112-b6db-3ffedf52c464]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:14 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:14 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:15 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.421s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.b88f3685-4d37-495e-aeeb-e5373463b0dcg7nuz6wg.img {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:15 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.b88f3685-4d37-495e-aeeb-e5373463b0dcg7nuz6wg.img Jul 31 07:31:15 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7e6f4952-5a9a-4a3a-8319-aec8f94f5d92 tempest-GroupSnapshotsV319Test-1169990734 None] Group tempest-GroupSnapshotsV319Test-Group-246412946: creating Jul 31 07:31:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7e6f4952-5a9a-4a3a-8319-aec8f94f5d92 tempest-GroupSnapshotsV319Test-1169990734 None] Group tempest-GroupSnapshotsV319Test-Group-246412946: created successfully Jul 31 07:31:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7e6f4952-5a9a-4a3a-8319-aec8f94f5d92 tempest-GroupSnapshotsV319Test-1169990734 None] Create group completed successfully. Jul 31 07:31:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Acquiring lock "cinder-c115e6fb-0ed1-4821-9999-5d3d4a5feadd-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Lock "cinder-c115e6fb-0ed1-4821-9999-5d3d4a5feadd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Acquiring lock "cinder-quobyte-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" acquired by "delete_volume" :: waited 0.040s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:16 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4605d560-7fe8-422f-b2ba-cf4a76ff1f5c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:16 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd Jul 31 07:31:16 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:17 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" returned: 0 in 1.049s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:17 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd Jul 31 07:31:17 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:17 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" returned: 0 in 0.375s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-c115e6fb-0ed1-4821-9999-5d3d4a5feadd" released by "delete_volume" :: held 1.560s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:17 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Created reservations ['5ebe4649-21a2-4641-95a8-b0b40b6c7467', '87058de1-dc4d-4a22-ad9f-a32774015d40', '13728784-b995-40b4-8335-a80a0acacb4c', 'ea5019a0-b558-48d1-a3f5-fa3712669bb9'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:18 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:31:18 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Flow 'volume_create_manager' (49866183-fdc3-455d-bdc1-fb39045f2320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2c198f-5888-46f5-91f3-26902837dd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2c198f-5888-46f5-91f3-26902837dd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316560020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ee6cd7b-cd34-42a4-8fe4-1c4cda807d2e,host='devstack@QuobyteHD#QuobyteHD',id=5eeb79d1-5f84-40be-afae-9b897f16c3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c8171b012a43b5a565ac99ff2fea7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:18Z,use_quota=True,user_id='e21823516b8c4102a3e18a9bea121f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7df8a242-02aa-4c47-8650-259ab5c84967),volume_type_id=7df8a242-02aa-4c47-8650-259ab5c84967)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e1e987-43f4-4a07-bd29-9cf4ac7f5fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e1e987-43f4-4a07-bd29-9cf4ac7f5fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb974b1-19ca-4e82-bffe-c03bf3e60928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb974b1-19ca-4e82-bffe-c03bf3e60928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eeb79d1-5f84-40be-afae-9b897f16c3bf', 'volume_name': 'volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c57d1c-9488-4caf-ae7f-46dbf04096e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c57d1c-9488-4caf-ae7f-46dbf04096e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14760f4b-d09f-40fe-8374-dfc41ddddd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Volume 5eeb79d1-5f84-40be-afae-9b897f16c3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf', 'volume_size': 1} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Acquiring lock "cinder-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Lock "cinder-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Acquiring lock "cinder-quobyte-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:19 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 1.331s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:31:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Deleted volume successfully. Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd14501-1b4c-46c4-acba-7f09ec763262]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7ed8d6a9-1497-499b-ae37-b1a4f6ecd761 tempest-VolumesCloneTest-454155061 None] Lock "cinder-c115e6fb-0ed1-4821-9999-5d3d4a5feadd-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:19 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 Jul 31 07:31:19 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:20 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" returned: 0 in 0.840s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:20 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2 Jul 31 07:31:20 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:20 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" returned: 0 in 0.667s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Lock "cinder-quobyte-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2" released by "delete_volume" :: held 1.701s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:21 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.b88f3685-4d37-495e-aeeb-e5373463b0dcg7nuz6wg.img" returned: 0 in 5.763s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Created reservations ['845f5c5c-6956-4ea0-a92f-7780b5a22f09', '259fb233-f163-47d7-ad90-f2bddcea3d05', '7570742b-7749-42e7-9c98-f28dee4abe15', '19143573-30fc-4d84-b47c-42f916f108a8'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c652c9-1270-4d2b-85cc-1896aaa7468e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:21 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:21 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:21 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:31:21 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:21 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.307s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:31:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Deleted volume successfully. Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d1da4c3-a39f-491f-b692-f0b946a963b6 tempest-VolumesCloneTest-454155061 None] Lock "cinder-b30e8e9d-75a7-48ed-92fb-06a3ca76d5b2-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:21 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.637s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.b88f3685-4d37-495e-aeeb-e5373463b0dcg7nuz6wg.img {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:31:21 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Converted 1024.00 MB image at 177.63 MB/s Jul 31 07:31:21 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] b88f3685-4d37-495e-aeeb-e5373463b0dc was raw, no need to convert to raw {{(pid=88915) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Flow 'volume_create_manager' (4d264317-cbb1-4515-857e-d935d6e18b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cf43b4-2d4b-46c1-a10f-d653b02eb982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cf43b4-2d4b-46c1-a10f-d653b02eb982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1055215693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757dd03e-4bce-4792-8143-b5752d2f462d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='461fa02f4a1c447a8a657f3ecd9a781f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:26Z,use_quota=True,user_id='cf40adcbc6c9452295ee8ac9d12c2bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107f67ab-431b-48cd-8ffe-3f37e5c60819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107f67ab-431b-48cd-8ffe-3f37e5c60819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14495d82-a087-459e-939f-32b460df0ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14495d82-a087-459e-939f-32b460df0ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757dd03e-4bce-4792-8143-b5752d2f462d', 'volume_name': 'volume-757dd03e-4bce-4792-8143-b5752d2f462d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c923073-7a88-4dcd-822c-ef7f705fb6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c923073-7a88-4dcd-822c-ef7f705fb6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5cf104-92df-4e39-bba0-2f1f4c9ea93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:25 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Volume 757dd03e-4bce-4792-8143-b5752d2f462d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757dd03e-4bce-4792-8143-b5752d2f462d', 'volume_size': 1} Jul 31 07:31:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:31:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:33 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:31:33 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:34 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.468s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:31:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:31:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:31:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:31:35 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=132,cinder:UPDATE=148,cinder:INSERT=29,cinder:DELETE=5 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:31:35 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=103,cinder:INSERT=34,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:31:42 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Flow 'volume_create_manager' (cf322d41-ae9e-48c0-815b-fd055c01a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b579d4f3-cbac-4a0a-b8cc-115a4cda3616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b579d4f3-cbac-4a0a-b8cc-115a4cda3616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1705105524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee05502-293b-43db-8ca2-2a10196edd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235b19db951c42cdb8dbbdbfe8c3ecd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:43Z,use_quota=True,user_id='671d409836b1404dbb01f660fbdbdc1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a326c64-f530-4db3-8d9d-468b18f77af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a326c64-f530-4db3-8d9d-468b18f77af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b4d13-e9f5-420f-8c91-e0b08578cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b4d13-e9f5-420f-8c91-e0b08578cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ee05502-293b-43db-8ca2-2a10196edd32', 'volume_name': 'volume-2ee05502-293b-43db-8ca2-2a10196edd32', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ddba26-4062-410c-ba26-b0ee59e550a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ddba26-4062-410c-ba26-b0ee59e550a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6b8d29-be24-455e-a9e9-a038f74aa990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:43 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Volume 2ee05502-293b-43db-8ca2-2a10196edd32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ee05502-293b-43db-8ca2-2a10196edd32', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Trying to clone 2ee05502-293b-43db-8ca2-2a10196edd32 from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:31:43 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:31:43 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Image download 20.69 MB at 20.69 MB/s Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c800b2-5644-4548-a276-0c6f44fe14c8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:44 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD Jul 31 07:31:44 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:44 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e is fetched for user 671d409836b1404dbb01f660fbdbdc1d. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee24bfe0-f144-4ff6-8249-10d4d03f8c6e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:44 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD Jul 31 07:31:44 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.348s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Uploaded volume to glance image-id: b88f3685-4d37-495e-aeeb-e5373463b0dc. {{(pid=88915) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.639s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8ee6cd7b-cd34-42a4-8fe4-1c4cda807d2e,created_at=2026-07-31T05:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316560020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ee6cd7b-cd34-42a4-8fe4-1c4cda807d2e,host='devstack@QuobyteHD#QuobyteHD',id=5eeb79d1-5f84-40be-afae-9b897f16c3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c8171b012a43b5a565ac99ff2fea7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:18Z,use_quota=True,user_id='e21823516b8c4102a3e18a9bea121f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7df8a242-02aa-4c47-8650-259ab5c84967),volume_type_id=7df8a242-02aa-4c47-8650-259ab5c84967)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Creating volume 5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:31:44 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:44 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf 1073741824 Jul 31 07:31:44 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-30290726-2518-458e-9c5c-0fd65f9328b7 tempest-VolumesActionsTest-478448541 None] Copy volume to image completed successfully. Jul 31 07:31:44 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:45 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf 1073741824" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:45 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf Jul 31 07:31:45 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:45 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf" returned: 0 in 0.253s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.564s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1055215693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757dd03e-4bce-4792-8143-b5752d2f462d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='461fa02f4a1c447a8a657f3ecd9a781f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:26Z,use_quota=True,user_id='cf40adcbc6c9452295ee8ac9d12c2bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Creating volume 757dd03e-4bce-4792-8143-b5752d2f462d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:31:45 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:45 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d 1073741824 Jul 31 07:31:45 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14760f4b-d09f-40fe-8374-dfc41ddddd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86938d28-9240-4b9a-ba1a-8d3210c3edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Volume volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf (5eeb79d1-5f84-40be-afae-9b897f16c3bf): created successfully Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86938d28-9240-4b9a-ba1a-8d3210c3edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Flow 'volume_create_manager' (49866183-fdc3-455d-bdc1-fb39045f2320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1cd51ddf-3382-4bba-80d8-b96f106c1af1 tempest-GroupSnapshotsV319Test-1169990734 None] Created volume successfully. Jul 31 07:31:45 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d 1073741824" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:45 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d Jul 31 07:31:45 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:46 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d" returned: 0 in 0.262s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1705105524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee05502-293b-43db-8ca2-2a10196edd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235b19db951c42cdb8dbbdbfe8c3ecd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:43Z,use_quota=True,user_id='671d409836b1404dbb01f660fbdbdc1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Creating volume 2ee05502-293b-43db-8ca2-2a10196edd32 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:31:46 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5cf104-92df-4e39-bba0-2f1f4c9ea93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757dd03e-4bce-4792-8143-b5752d2f462d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1fd69a-9d50-493f-b1a3-a034e4b81324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:46 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 1073741824 Jul 31 07:31:46 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Volume volume-757dd03e-4bce-4792-8143-b5752d2f462d (757dd03e-4bce-4792-8143-b5752d2f462d): created successfully Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1fd69a-9d50-493f-b1a3-a034e4b81324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Flow 'volume_create_manager' (4d264317-cbb1-4515-857e-d935d6e18b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-67ca75ad-a4ce-4ace-bc5f-0e1a4d2bc2fd tempest-VolumesListTestJSON-449171420 None] Created volume successfully. Jul 31 07:31:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] GroupSnapshot 26a7d609-9cda-4e6d-8113-3818a2073b3d: creating. Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Group snapshot 26a7d609-9cda-4e6d-8113-3818a2073b3d: creating. {{(pid=88915) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:46 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 1073741824" returned: 0 in 0.446s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:46 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 Jul 31 07:31:46 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:46 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32" returned: 0 in 0.241s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.950s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0364b-9ea9-4dab-b47c-ac681a20b565]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:46 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Attempting download of 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume 2ee05502-293b-43db-8ca2-2a10196edd32. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[32083410-5538-4a2d-bcb9-ce073c9fcba4]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_z9bgnuso {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:47 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:47 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:47 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_z9bgnuso Jul 31 07:31:47 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:47 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c54f14-bb29-4919-975f-c198d2e16902]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:47 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_z9bgnuso" returned: 0 in 0.362s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_z9bgnuso {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:47 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:47 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:47 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_z9bgnuso Jul 31 07:31:47 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:47 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_z9bgnuso" returned: 1 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_z9bgnuso' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[15041c15-d3e7-4457-82c9-0e662ffc7de2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:47 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.426s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:47 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img Jul 31 07:31:47 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:47 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD Jul 31 07:31:47 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Flow 'volume_create_manager' (ec4279c8-a9c0-4258-9c8c-44a4a6aa04b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6ae90f-e86d-4528-a807-4ba728db6197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6ae90f-e86d-4528-a807-4ba728db6197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-167564580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429d4afa-cccd-4689-88ca-6b870ee1f01d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='461fa02f4a1c447a8a657f3ecd9a781f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:48Z,use_quota=True,user_id='cf40adcbc6c9452295ee8ac9d12c2bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397e6895-7ff5-4729-bcfe-a76ef334bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397e6895-7ff5-4729-bcfe-a76ef334bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1207cc-1596-4d0f-bd2c-18b38057f38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1207cc-1596-4d0f-bd2c-18b38057f38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429d4afa-cccd-4689-88ca-6b870ee1f01d', 'volume_name': 'volume-429d4afa-cccd-4689-88ca-6b870ee1f01d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f783eb9-d7be-43df-adb9-0236509c76b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f783eb9-d7be-43df-adb9-0236509c76b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e833efc7-33dd-4cd3-b78a-74d4b3f8e863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:48 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Volume 429d4afa-cccd-4689-88ca-6b870ee1f01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429d4afa-cccd-4689-88ca-6b870ee1f01d', 'volume_size': 1} Jul 31 07:31:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:48 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:48 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] 0c598684-d1fc-49c0-b0cf-3a02a6f8533e was qcow2, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:31:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:48 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 Jul 31 07:31:48 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:51 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32" returned: 0 in 3.593s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:51 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_6ow9o_j0devstack@QuobyteHD, size 112.00 MB, duration 3.59 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:31:51 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Converted 112.00 MB image at 31.16 MB/s Jul 31 07:31:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:51 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 1G Jul 31 07:31:51 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:52 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 1G" returned: 0 in 0.605s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Downloaded image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume 2ee05502-293b-43db-8ca2-2a10196edd32 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e for user 671d409836b1404dbb01f660fbdbdc1d is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Marking volume 2ee05502-293b-43db-8ca2-2a10196edd32 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Copying metadata from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e to 2ee05502-293b-43db-8ca2-2a10196edd32. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Creating volume glance metadata for volume 2ee05502-293b-43db-8ca2-2a10196edd32 backed by image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:31:52 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img" returned: 0 in 4.664s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2410a53f-43d3-454f-b6d1-cb67814fa3a0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6b8d29-be24-455e-a9e9-a038f74aa990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee05502-293b-43db-8ca2-2a10196edd32', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8d5bed-3ada-4cd4-8dd4-ddd03f15d098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:52 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Volume volume-2ee05502-293b-43db-8ca2-2a10196edd32 (2ee05502-293b-43db-8ca2-2a10196edd32): created successfully Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8d5bed-3ada-4cd4-8dd4-ddd03f15d098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Flow 'volume_create_manager' (cf322d41-ae9e-48c0-815b-fd055c01a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:52 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4ce488af-294a-4fe7-bcc7-485c4eb574c7 tempest-TestShelveInstance-340392848 None] Created volume successfully. Jul 31 07:31:52 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:52 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:53 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.550s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:31:53 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Converted 1024.00 MB image at 219.49 MB/s Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] d713d07f-7ffd-4339-876b-bb36a3687cd8 was raw, converting to qcow2 {{(pid=88915) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c034b1-2bad-4474-99e3-6ee9e497eb3a]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:53 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img Jul 31 07:31:53 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:53 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img" returned: 0 in 0.322s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:53 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img Jul 31 07:31:53 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:53 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img" returned: 1 in 0.381s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:31:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img /opt/stack/data/cinder/conversion/vol_upload_bx3eh8cp {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:53 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img /opt/stack/data/cinder/conversion/vol_upload_bx3eh8cp Jul 31 07:31:53 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:54 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img /opt/stack/data/cinder/conversion/vol_upload_bx3eh8cp" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:54 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Image conversion details: src /opt/stack/data/cinder/conversion/67c6e13b-e643-46ca-a902-34448ce6d357.temp_image.d713d07f-7ffd-4339-876b-bb36a3687cd8hy974pbl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_bx3eh8cp {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:31:54 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 07:31:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad3cf11-0d54-4d14-8ee4-9ed5d02d3410]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bx3eh8cp {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:54 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bx3eh8cp Jul 31 07:31:54 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:54 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bx3eh8cp" returned: 0 in 0.342s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-9ecd85fc-30f6-45a6-8605-4ea24fb5f393 req-b1db91c2-cf87-4276-99ca-a7dfaff2054d tempest-TestShelveInstance-340392848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.122s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Uploaded volume to glance image-id: d713d07f-7ffd-4339-876b-bb36a3687cd8. {{(pid=88915) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.780s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Creating offline snapshot e0c9098d-4f36-42a7-acff-b7d6f424931e of volume 5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:31:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d2af516d-d158-4240-a167-ee5a92d995f6 tempest-VolumesActionsTest-478448541 None] Copy volume to image completed successfully. Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[064db0bb-5aaf-48e4-ace1-9799d7787173]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:56 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf Jul 31 07:31:56 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:56 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf" returned: 0 in 0.396s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:56 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e 1G Jul 31 07:31:56 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:57 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e 1G" returned: 0 in 0.519s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:57 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e Jul 31 07:31:57 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Acquiring lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Acquiring lock "cinder-quobyte-67c6e13b-e643-46ca-a902-34448ce6d357" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Lock "cinder-quobyte-67c6e13b-e643-46ca-a902-34448ce6d357" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ba9a4-7171-4fc1-857f-4299a50146f3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:57 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e" returned: 0 in 0.389s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:57 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:57 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e Jul 31 07:31:57 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:57 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:57 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:57 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e" returned: 0 in 0.284s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:57 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.info Jul 31 07:31:57 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:57 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.448s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:57 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357 Jul 31 07:31:57 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:58 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.info" returned: 0 in 0.264s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:58 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:58 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.info Jul 31 07:31:58 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:58 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-67c6e13b-e643-46ca-a902-34448ce6d357" returned: 0 in 0.258s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Lock "cinder-quobyte-67c6e13b-e643-46ca-a902-34448ce6d357" released by "delete_volume" :: held 0.746s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Created reservations ['9fbb8500-5229-4769-857e-b376dfc2e292', '16c80f26-0bc9-406d-923c-52ff72ad35fd', 'f2ab9333-2926-4ef0-bcc1-ed8fe06eaa06', '90372cbe-7fe3-42a7-bf2b-f7fb44f86b8d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:58 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:31:58 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:58 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.info" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.326s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-167564580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429d4afa-cccd-4689-88ca-6b870ee1f01d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='461fa02f4a1c447a8a657f3ecd9a781f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:31:48Z,use_quota=True,user_id='cf40adcbc6c9452295ee8ac9d12c2bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Creating volume 429d4afa-cccd-4689-88ca-6b870ee1f01d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:31:58 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:58 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d 1073741824 Jul 31 07:31:58 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-683829f0-43f4-4491-83e7-06ff183a3984 tempest-GroupSnapshotsV319Test-1169990734 None] group_snapshot 26a7d609-9cda-4e6d-8113-3818a2073b3d: created successfully Jul 31 07:31:58 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:31:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Deleted volume successfully. Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-89bb6c31-70b8-4e2b-b452-933b8e8d6612 tempest-VolumesActionsTest-478448541 None] Lock "cinder-67c6e13b-e643-46ca-a902-34448ce6d357-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:31:58 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d 1073741824" returned: 0 in 0.500s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:58 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d Jul 31 07:31:58 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:31:59 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d" returned: 0 in 0.282s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-9ecd85fc-30f6-45a6-8605-4ea24fb5f393 req-b1db91c2-cf87-4276-99ca-a7dfaff2054d tempest-TestShelveInstance-340392848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.804s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e833efc7-33dd-4cd3-b78a-74d4b3f8e863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429d4afa-cccd-4689-88ca-6b870ee1f01d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e395c39f-a94f-41c0-9756-b25bc3d401d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-9ecd85fc-30f6-45a6-8605-4ea24fb5f393 req-b1db91c2-cf87-4276-99ca-a7dfaff2054d tempest-TestShelveInstance-340392848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:31:59 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Volume volume-429d4afa-cccd-4689-88ca-6b870ee1f01d (429d4afa-cccd-4689-88ca-6b870ee1f01d): created successfully Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e395c39f-a94f-41c0-9756-b25bc3d401d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Flow 'volume_create_manager' (ec4279c8-a9c0-4258-9c8c-44a4a6aa04b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:31:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c57df110-c4ae-4cd4-92da-ac2a526e82ab tempest-VolumesListTestJSON-449171420 None] Created volume successfully. Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-9ecd85fc-30f6-45a6-8605-4ea24fb5f393 req-b1db91c2-cf87-4276-99ca-a7dfaff2054d tempest-TestShelveInstance-340392848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-2ee05502-293b-43db-8ca2-2a10196edd32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45a77e8c-0cde-47e4-85f4-af916d1d3ed5', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:31:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-9ecd85fc-30f6-45a6-8605-4ea24fb5f393 req-b1db91c2-cf87-4276-99ca-a7dfaff2054d tempest-TestShelveInstance-340392848 None] attachment_update completed successfully. Jul 31 07:31:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] group_snapshot 26a7d609-9cda-4e6d-8113-3818a2073b3d: deleting Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] group_snapshot 26a7d609-9cda-4e6d-8113-3818a2073b3d: deleting {{(pid=88915) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Acquiring lock "cinder-quobyte-5eeb79d1-5f84-40be-afae-9b897f16c3bf" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Lock "cinder-quobyte-5eeb79d1-5f84-40be-afae-9b897f16c3bf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Acquiring lock "cinder-quobyte-e0c9098d-4f36-42a7-acff-b7d6f424931e" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Lock "cinder-quobyte-e0c9098d-4f36-42a7-acff-b7d6f424931e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Deleting offline snapshot e0c9098d-4f36-42a7-acff-b7d6f424931e of volume 5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] snapshot_file for this snap is: volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd54ef-cb4f-4e50-b848-308b4d11fb28]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:31:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:31:59 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e Jul 31 07:31:59 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:00 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e" returned: 0 in 0.478s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f00bddc-7d0a-4e1d-b932-f451f791490d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:00 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf Jul 31 07:32:00 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:00 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf" returned: 0 in 0.707s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:00 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e Jul 31 07:32:00 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Flow 'volume_create_manager' (1e49bff4-73c9-4e0d-9ca9-491cd673e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d32ba93-86a6-4a33-b64b-20af58811e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d32ba93-86a6-4a33-b64b-20af58811e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-588000420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3019ecdd-ef16-4761-8eec-e774a00e73ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='461fa02f4a1c447a8a657f3ecd9a781f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:01Z,use_quota=True,user_id='cf40adcbc6c9452295ee8ac9d12c2bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f773ba37-4317-4d68-a2b9-4217cdf088b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f773ba37-4317-4d68-a2b9-4217cdf088b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc6354a-00df-4bd4-88ce-2098f6bef65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc6354a-00df-4bd4-88ce-2098f6bef65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3019ecdd-ef16-4761-8eec-e774a00e73ed', 'volume_name': 'volume-3019ecdd-ef16-4761-8eec-e774a00e73ed', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc77f028-6315-4e8f-87c2-8fc4938da54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc77f028-6315-4e8f-87c2-8fc4938da54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91205b5-31eb-427a-8381-5532cdbea2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:01 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Volume 3019ecdd-ef16-4761-8eec-e774a00e73ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3019ecdd-ef16-4761-8eec-e774a00e73ed', 'volume_size': 1} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-588000420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3019ecdd-ef16-4761-8eec-e774a00e73ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='461fa02f4a1c447a8a657f3ecd9a781f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:01Z,use_quota=True,user_id='cf40adcbc6c9452295ee8ac9d12c2bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Creating volume 3019ecdd-ef16-4761-8eec-e774a00e73ed {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:01 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:01 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed 1073741824 Jul 31 07:32:01 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:01 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e" returned: 0 in 0.586s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:01 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e Jul 31 07:32:01 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:01 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf.e0c9098d-4f36-42a7-acff-b7d6f424931e" returned: 0 in 0.464s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Lock "cinder-quobyte-e0c9098d-4f36-42a7-acff-b7d6f424931e" released by "_delete_snapshot" :: held 2.391s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Lock "cinder-quobyte-5eeb79d1-5f84-40be-afae-9b897f16c3bf" released by "delete_snapshot" :: held 2.423s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:02 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed 1073741824" returned: 0 in 0.814s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:02 devstack cinder-volume[88915]: WARNING cinder.quota [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1945503916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1945503916, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:32:02 devstack cinder-volume[88915]: WARNING cinder.quota [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1945503916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1945503916, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] Created reservations ['aee69ce4-b2bd-457b-b02e-675e92e7e260', '0e8706c4-2fca-49a4-95bf-79c28b1a4c99', 'e113c678-74d2-4201-b985-95f47722956c', 'e229aafc-4d13-45cd-8b9d-1d51eb9cf186'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:02 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed Jul 31 07:32:02 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6630b741-31f8-4958-9787-7dbba9b8e95e tempest-GroupSnapshotsV319Test-1169990734 None] group_snapshot 26a7d609-9cda-4e6d-8113-3818a2073b3d: deleted successfully Jul 31 07:32:02 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed" returned: 0 in 0.297s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91205b5-31eb-427a-8381-5532cdbea2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3019ecdd-ef16-4761-8eec-e774a00e73ed', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f743a004-dc70-4fdd-bf6b-658fafee4c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:02 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Volume volume-3019ecdd-ef16-4761-8eec-e774a00e73ed (3019ecdd-ef16-4761-8eec-e774a00e73ed): created successfully Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f743a004-dc70-4fdd-bf6b-658fafee4c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:02 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Flow 'volume_create_manager' (1e49bff4-73c9-4e0d-9ca9-491cd673e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-33fe3a9c-797f-42fd-858d-924e5f82acf7 tempest-VolumesListTestJSON-449171420 None] Created volume successfully. Jul 31 07:32:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Acquiring lock "cinder-quobyte-5eeb79d1-5f84-40be-afae-9b897f16c3bf" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "cinder-quobyte-5eeb79d1-5f84-40be-afae-9b897f16c3bf" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bbd70a-68ef-4ca1-9738-093905f0173e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:03 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf Jul 31 07:32:03 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:04 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf" returned: 0 in 0.671s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:04 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf Jul 31 07:32:04 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:04 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5eeb79d1-5f84-40be-afae-9b897f16c3bf" returned: 0 in 0.557s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "cinder-quobyte-5eeb79d1-5f84-40be-afae-9b897f16c3bf" released by "delete_volume" :: held 1.409s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Created reservations ['ef9d3201-9f4b-4533-8783-5d64345bf3dd'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:05 devstack cinder-volume[88915]: WARNING cinder.quota [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1945503916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1945503916, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Created reservations ['db0d0c25-6814-43a0-9875-93fc74c5eb90', 'ce1100c8-5e3b-4db6-ba86-35ecb0bc8670', 'eb161d42-152e-44ed-acec-44018def8d1b', '2a5ac68f-9af0-471a-87ff-9ae3b3b41a24'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:05 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:05 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:05 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:05 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f22394c2-e502-4e31-a824-932ce7574f22 tempest-GroupSnapshotsV319Test-1169990734 None] Delete group completed successfully. Jul 31 07:32:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Acquiring lock "cinder-3019ecdd-ef16-4761-8eec-e774a00e73ed-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Lock "cinder-3019ecdd-ef16-4761-8eec-e774a00e73ed-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Acquiring lock "cinder-quobyte-3019ecdd-ef16-4761-8eec-e774a00e73ed" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Lock "cinder-quobyte-3019ecdd-ef16-4761-8eec-e774a00e73ed" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87dc41-47a2-46c2-8672-c6504cf817b8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:08 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed Jul 31 07:32:08 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:08 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed" returned: 0 in 0.737s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:08 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed Jul 31 07:32:08 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:09 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3019ecdd-ef16-4761-8eec-e774a00e73ed" returned: 0 in 0.464s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Lock "cinder-quobyte-3019ecdd-ef16-4761-8eec-e774a00e73ed" released by "delete_volume" :: held 1.267s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Created reservations ['f6725aee-5435-46ab-a4ea-49e72cac570e', 'ac6d5b6a-b36e-4ed8-a41f-f93128672307', 'df43a157-8b79-4c93-81af-8d4b719b58eb', '71d371b6-2882-4a94-aa5e-07a7d651d2d0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:09 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:09 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:10 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.457s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Deleted volume successfully. Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-67b298d0-b41c-41fc-a344-edec56edae2e tempest-VolumesListTestJSON-449171420 None] Lock "cinder-3019ecdd-ef16-4761-8eec-e774a00e73ed-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Acquiring lock "cinder-429d4afa-cccd-4689-88ca-6b870ee1f01d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Lock "cinder-429d4afa-cccd-4689-88ca-6b870ee1f01d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Acquiring lock "cinder-quobyte-429d4afa-cccd-4689-88ca-6b870ee1f01d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Lock "cinder-quobyte-429d4afa-cccd-4689-88ca-6b870ee1f01d" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[01014b50-e37f-4094-afdc-d132deb8c5a2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:10 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d Jul 31 07:32:10 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:11 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d" returned: 0 in 0.571s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:11 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d Jul 31 07:32:11 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:11 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-429d4afa-cccd-4689-88ca-6b870ee1f01d" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Lock "cinder-quobyte-429d4afa-cccd-4689-88ca-6b870ee1f01d" released by "delete_volume" :: held 0.930s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Created reservations ['7ec9b2bf-b6e4-4ec6-bd46-df6f399e317b', 'a031a462-2bfd-486d-b3ec-c40f7f59818a', '3b1a6ac9-6a53-4858-b97f-9284e3d4423b', '54a7b9f6-2862-4c44-91a4-4fb33081212a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:11 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:11 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Acquiring lock "cinder-757dd03e-4bce-4792-8143-b5752d2f462d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Lock "cinder-757dd03e-4bce-4792-8143-b5752d2f462d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Acquiring lock "cinder-quobyte-757dd03e-4bce-4792-8143-b5752d2f462d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Lock "cinder-quobyte-757dd03e-4bce-4792-8143-b5752d2f462d" acquired by "delete_volume" :: waited 0.056s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ee458f-a917-4361-bf43-bf93e3f67874]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:12 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.605s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Deleted volume successfully. Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6d925650-de8c-4cae-a54f-b7726d753766 tempest-VolumesListTestJSON-449171420 None] Lock "cinder-429d4afa-cccd-4689-88ca-6b870ee1f01d-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:12 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d Jul 31 07:32:12 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:12 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d" returned: 0 in 0.587s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:13 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d Jul 31 07:32:13 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:13 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-757dd03e-4bce-4792-8143-b5752d2f462d" returned: 0 in 0.317s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Lock "cinder-quobyte-757dd03e-4bce-4792-8143-b5752d2f462d" released by "delete_volume" :: held 0.988s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Created reservations ['8f1effd3-565e-4c9d-a4db-f3ff3a1b3fbf', 'd2f99b37-2ee0-4e46-b366-a27f2d0f1032', 'a298b923-a25c-4316-b3a2-55e7d62a45c5', 'c1be6f0e-4d5f-4859-bb46-e596d65f9f69'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:13 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:13 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:13 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Deleted volume successfully. Jul 31 07:32:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-624268bb-7cf0-4a23-8e5d-8f152823377a tempest-VolumesListTestJSON-449171420 None] Lock "cinder-757dd03e-4bce-4792-8143-b5752d2f462d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Flow 'volume_create_manager' (30df3c7a-1bf4-4cb1-b03c-56d8de314eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23aec9f4-9ada-4bf2-8b1e-3757653fa38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23aec9f4-9ada-4bf2-8b1e-3757653fa38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-284315844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab785c8-c893-443c-bcf0-d6009728bb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02da50a13eb4b50806df59162309945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:15Z,use_quota=True,user_id='b2ec5ecb42c442e68eca9ad4ad72ed52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d585ea-22e9-4853-9768-16a02989c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d585ea-22e9-4853-9768-16a02989c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb88f2f7-d262-4155-ba6f-c718cc5517a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb88f2f7-d262-4155-ba6f-c718cc5517a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab785c8-c893-443c-bcf0-d6009728bb14', 'volume_name': 'volume-eab785c8-c893-443c-bcf0-d6009728bb14', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763ebbb8-fe7f-48f4-93db-3ada98f42099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763ebbb8-fe7f-48f4-93db-3ada98f42099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e782b4c-2071-4858-b60c-74da4dd44cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Volume eab785c8-c893-443c-bcf0-d6009728bb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab785c8-c893-443c-bcf0-d6009728bb14', 'volume_size': 1} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-284315844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab785c8-c893-443c-bcf0-d6009728bb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02da50a13eb4b50806df59162309945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:15Z,use_quota=True,user_id='b2ec5ecb42c442e68eca9ad4ad72ed52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Creating volume eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:14 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:14 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 1073741824 Jul 31 07:32:14 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fe5d9a56-f6d3-4f87-a32b-8364b82c2359 tempest-GroupsTest-2095321304 None] Group tempest-Group1-2079375111: creating Jul 31 07:32:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fe5d9a56-f6d3-4f87-a32b-8364b82c2359 tempest-GroupsTest-2095321304 None] Group tempest-Group1-2079375111: created successfully Jul 31 07:32:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fe5d9a56-f6d3-4f87-a32b-8364b82c2359 tempest-GroupsTest-2095321304 None] Create group completed successfully. Jul 31 07:32:15 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 1073741824" returned: 0 in 0.551s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:15 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 Jul 31 07:32:15 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:15 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14" returned: 0 in 0.303s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e782b4c-2071-4858-b60c-74da4dd44cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab785c8-c893-443c-bcf0-d6009728bb14', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603a75c1-1ca1-43f2-9d15-65d980fd1726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Volume volume-eab785c8-c893-443c-bcf0-d6009728bb14 (eab785c8-c893-443c-bcf0-d6009728bb14): created successfully Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603a75c1-1ca1-43f2-9d15-65d980fd1726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Flow 'volume_create_manager' (30df3c7a-1bf4-4cb1-b03c-56d8de314eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-debab9b1-650c-49e9-afa5-c1bafe08b05e tempest-VolumesSnapshotListTestJSON-76977473 None] Created volume successfully. Jul 31 07:32:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7b9f3bb2-f73b-4718-8e03-42eed505a365 tempest-GroupsTest-2095321304 None] Group tempest-Group2-979363520: creating Jul 31 07:32:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7b9f3bb2-f73b-4718-8e03-42eed505a365 tempest-GroupsTest-2095321304 None] Group tempest-Group2-979363520: created successfully Jul 31 07:32:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7b9f3bb2-f73b-4718-8e03-42eed505a365 tempest-GroupsTest-2095321304 None] Create group completed successfully. Jul 31 07:32:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Creating offline snapshot 763c2123-aa5f-47e6-9351-c88ac2132ded of volume eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:32:17 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c4eeb-a667-452c-89d4-235b26f0eb5d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:17 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 Jul 31 07:32:17 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:17 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14" returned: 0 in 0.477s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:17 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded 1G Jul 31 07:32:17 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:18 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded 1G" returned: 0 in 0.590s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:18 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded Jul 31 07:32:18 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Flow 'volume_create_manager' (cc2c1964-dd4b-40f0-92c0-1efe71190695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef3aa48-738c-49b0-a307-a1fd7b86eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef3aa48-738c-49b0-a307-a1fd7b86eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990788163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfbc650-7fea-4129-aab1-895fb368fb51,host='devstack@QuobyteHD#QuobyteHD',id=05588e87-2d30-44b3-b1ae-5d2daffb843b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4ecc757984212995a46c7799c3d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:18Z,use_quota=True,user_id='f20d8ca66c63424082d4eab3e350a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cfec2fe-eb7f-43e2-9644-388d4994e529),volume_type_id=5cfec2fe-eb7f-43e2-9644-388d4994e529)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0704c1-038e-4e41-8c69-0c55f2ef4f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0704c1-038e-4e41-8c69-0c55f2ef4f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14535ec1-c9e9-4b3d-9d03-fbf38f7db492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14535ec1-c9e9-4b3d-9d03-fbf38f7db492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05588e87-2d30-44b3-b1ae-5d2daffb843b', 'volume_name': 'volume-05588e87-2d30-44b3-b1ae-5d2daffb843b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8851ff-acb0-4a89-b0f2-e6d5e4d6ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8851ff-acb0-4a89-b0f2-e6d5e4d6ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975e9a6f-970c-4775-a9f6-d732fbcd7e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Volume 05588e87-2d30-44b3-b1ae-5d2daffb843b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05588e87-2d30-44b3-b1ae-5d2daffb843b', 'volume_size': 1} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (de707ff0-66de-4f0c-b073-6969d0e8fb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f707a0-4725-4cb8-aed8-872db0946033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f707a0-4725-4cb8-aed8-872db0946033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776594869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6319ba-180d-40de-8f7e-7e2803d7b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:18Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e2cdbc-6511-48c1-b6bb-9ca85215507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e2cdbc-6511-48c1-b6bb-9ca85215507e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6432c4c3-8c55-4f61-951e-62721e9260e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6432c4c3-8c55-4f61-951e-62721e9260e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6319ba-180d-40de-8f7e-7e2803d7b733', 'volume_name': 'volume-fa6319ba-180d-40de-8f7e-7e2803d7b733', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fb515c-e722-4521-aa81-6e375b23bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fb515c-e722-4521-aa81-6e375b23bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedc81f7-d280-40f5-b6e9-f8f287dae482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume fa6319ba-180d-40de-8f7e-7e2803d7b733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6319ba-180d-40de-8f7e-7e2803d7b733', 'volume_size': 1} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded" returned: 0 in 0.334s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:18 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded is being set with open permissions: ugo+rw Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:18 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded Jul 31 07:32:18 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:18 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded" returned: 0 in 0.251s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:18 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.info Jul 31 07:32:18 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:19 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.info" returned: 0 in 0.243s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:19 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.info is being set with open permissions: ugo+rw Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:19 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.info Jul 31 07:32:19 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:19 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.info" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bfbc650-7fea-4129-aab1-895fb368fb51,created_at=2026-07-31T05:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990788163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfbc650-7fea-4129-aab1-895fb368fb51,host='devstack@QuobyteHD#QuobyteHD',id=05588e87-2d30-44b3-b1ae-5d2daffb843b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4ecc757984212995a46c7799c3d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:18Z,use_quota=True,user_id='f20d8ca66c63424082d4eab3e350a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cfec2fe-eb7f-43e2-9644-388d4994e529),volume_type_id=5cfec2fe-eb7f-43e2-9644-388d4994e529)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Creating volume 05588e87-2d30-44b3-b1ae-5d2daffb843b {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:19 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:19 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b 1073741824 Jul 31 07:32:19 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b51aa3cb-37a8-47e0-ae67-ce95d0043d01 tempest-VolumesSnapshotListTestJSON-76977473 None] Create snapshot completed successfully Jul 31 07:32:19 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b 1073741824" returned: 0 in 0.484s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:19 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b Jul 31 07:32:19 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:20 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.632s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776594869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6319ba-180d-40de-8f7e-7e2803d7b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:18Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Creating volume fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:20 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975e9a6f-970c-4775-a9f6-d732fbcd7e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05588e87-2d30-44b3-b1ae-5d2daffb843b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:20 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 1073741824 Jul 31 07:32:20 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c868aa-71cf-459f-ab20-130591e7a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:20 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Volume volume-05588e87-2d30-44b3-b1ae-5d2daffb843b (05588e87-2d30-44b3-b1ae-5d2daffb843b): created successfully Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c868aa-71cf-459f-ab20-130591e7a55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Flow 'volume_create_manager' (cc2c1964-dd4b-40f0-92c0-1efe71190695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:20 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c9502bde-a50a-402d-b182-1d8f1b6aa780 tempest-GroupsTest-2095321304 None] Created volume successfully. Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:20 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 1073741824" returned: 0 in 0.611s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:20 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 Jul 31 07:32:20 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:21 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733" returned: 0 in 0.293s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.587s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Acquiring lock "cinder-quobyte-05588e87-2d30-44b3-b1ae-5d2daffb843b" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedc81f7-d280-40f5-b6e9-f8f287dae482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6319ba-180d-40de-8f7e-7e2803d7b733', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b12142-999a-4f5e-b7ae-47493e058642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Lock "cinder-quobyte-05588e87-2d30-44b3-b1ae-5d2daffb843b" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Creating offline snapshot f3404cb5-63c6-43e2-9641-251141eed06b of volume eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3236897-839a-494d-a25c-2111047772ca]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[690a9b65-3465-4d2f-b828-1b0fe5cb0295]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:21 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 (fa6319ba-180d-40de-8f7e-7e2803d7b733): created successfully Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b12142-999a-4f5e-b7ae-47493e058642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (de707ff0-66de-4f0c-b073-6969d0e8fb9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-382d92e3-14c7-4696-aba5-1ef25ec70f53 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created volume successfully. Jul 31 07:32:21 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b Jul 31 07:32:21 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:21 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded Jul 31 07:32:21 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:21 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:21 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b" returned: 0 in 0.412s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded" returned: 0 in 0.395s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab785c8-c893-443c-bcf0-d6009728bb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:21 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b Jul 31 07:32:21 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:21 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b 1G Jul 31 07:32:21 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:21 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05588e87-2d30-44b3-b1ae-5d2daffb843b" returned: 0 in 0.250s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Lock "cinder-quobyte-05588e87-2d30-44b3-b1ae-5d2daffb843b" released by "delete_volume" :: held 0.734s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Created reservations ['7fad81f8-dfdb-49ac-9a10-ba6793b7c391'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:21 devstack cinder-volume[88915]: WARNING cinder.quota [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-909901215 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-909901215, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:32:21 devstack cinder-volume[88915]: WARNING cinder.quota [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-909901215 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-909901215, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:32:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Created reservations ['5ae98f5d-8f56-4a6a-97a0-efd40f22cd32', '622b4e57-7c52-4557-bd73-e732cfe35a0a', 'e97ec475-08ae-43d8-916b-8c2620950783', '402c44e5-914b-4257-a22b-304bf715b827'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:22 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b 1G" returned: 0 in 0.471s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:22 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:22 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:22 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b Jul 31 07:32:22 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:22 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.280s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-484521d8-c5bc-45a2-bbf7-d249cacf2622 tempest-GroupsTest-2095321304 None] Delete group completed successfully. Jul 31 07:32:22 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b" returned: 0 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:22 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b is being set with open permissions: ugo+rw Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:22 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b Jul 31 07:32:22 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Created reservations ['c06c51ac-0ad6-4bff-8bad-6e57169add88'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:22 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:22 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:22 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b" returned: 0 in 0.276s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.643s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.294s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Creating offline snapshot 21c4fb4b-2b29-4675-88d2-48b43072b467 of volume fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:32:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-68f42967-c8b6-4e6c-b119-ff5a7a1214d1 tempest-VolumesSnapshotListTestJSON-76977473 None] Create snapshot completed successfully Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[755e2a19-6887-40a7-94c6-54b62166e51f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:22 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:22 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ef1d399d-ee84-4479-97f3-d0beb81a5b26 tempest-GroupsTest-2095321304 None] Delete group completed successfully. Jul 31 07:32:22 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 Jul 31 07:32:22 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:23 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733" returned: 0 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:23 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 1G Jul 31 07:32:23 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:23 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 1G" returned: 0 in 0.391s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:23 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 Jul 31 07:32:23 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:23 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467" returned: 0 in 0.351s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:23 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 is being set with open permissions: ugo+rw Jul 31 07:32:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:23 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 Jul 31 07:32:23 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8f8d0689-4f7d-454e-843f-cb6c1c7e5cb9 tempest-GroupsTest-2095321304 None] Group tempest-GroupsTest-Group-591073969: creating Jul 31 07:32:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8f8d0689-4f7d-454e-843f-cb6c1c7e5cb9 tempest-GroupsTest-2095321304 None] Group tempest-GroupsTest-Group-591073969: created successfully Jul 31 07:32:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8f8d0689-4f7d-454e-843f-cb6c1c7e5cb9 tempest-GroupsTest-2095321304 None] Create group completed successfully. Jul 31 07:32:24 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467" returned: 0 in 0.258s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:24 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.info Jul 31 07:32:24 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:24 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.info" returned: 0 in 0.248s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:24 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.info is being set with open permissions: ugo+rw Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:24 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.info Jul 31 07:32:24 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:24 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.info" returned: 0 in 0.251s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.859s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Creating offline snapshot c74861e0-5d4c-49c6-b3fe-77c31a399fa9 of volume eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc717acb-814e-4e43-868f-37d387d69f53]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cc5039c2-7e3f-4447-ace9-a8071c534818 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Create snapshot completed successfully Jul 31 07:32:24 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b Jul 31 07:32:24 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:25 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab785c8-c893-443c-bcf0-d6009728bb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:25 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 1G Jul 31 07:32:25 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:25 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 1G" returned: 0 in 0.615s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:25 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 Jul 31 07:32:25 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Flow 'volume_create_manager' (fe0f15c4-1039-4d20-aa55-3302ea42d25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e60671a-592d-450d-bcb3-e50115249670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e60671a-592d-450d-bcb3-e50115249670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-813430605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2ad5136-fb10-476c-a467-887a6bfeb56e,host='devstack@QuobyteHD#QuobyteHD',id=9ad3afe8-7ebe-4c3a-ac42-cca620339c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4ecc757984212995a46c7799c3d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:26Z,use_quota=True,user_id='f20d8ca66c63424082d4eab3e350a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3df6a524-afd7-4002-b698-24a779ec50dc),volume_type_id=3df6a524-afd7-4002-b698-24a779ec50dc)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82034223-94ed-467c-add0-04534b705a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82034223-94ed-467c-add0-04534b705a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4290d8eb-c477-410e-b855-45715d7920d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4290d8eb-c477-410e-b855-45715d7920d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad3afe8-7ebe-4c3a-ac42-cca620339c3b', 'volume_name': 'volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d35c1e-328e-46fa-8258-c5fce4ba332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d35c1e-328e-46fa-8258-c5fce4ba332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5c8c9b-191f-47f3-815f-80df846db796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:25 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Volume 9ad3afe8-7ebe-4c3a-ac42-cca620339c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b', 'volume_size': 1} Jul 31 07:32:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:26 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9" returned: 0 in 0.405s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:26 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 is being set with open permissions: ugo+rw Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:26 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 Jul 31 07:32:26 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (d71e75a0-741f-4d43-8d05-ecdd8509533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3651bf-f9dd-44f6-b163-7b976aaea73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3651bf-f9dd-44f6-b163-7b976aaea73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213268709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f7e474-97db-4860-aaa4-1a4ed00fa036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:26Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc8a3c2-b7bd-4098-b0d4-50240f496c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc8a3c2-b7bd-4098-b0d4-50240f496c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9177be83-251e-4033-95de-45255f7dd222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9177be83-251e-4033-95de-45255f7dd222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f7e474-97db-4860-aaa4-1a4ed00fa036', 'volume_name': 'volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f865ced-664a-4df0-a165-ea8914d9a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f865ced-664a-4df0-a165-ea8914d9a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29e2c2-1ef0-452e-9c9a-b10e6cb4dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume a9f7e474-97db-4860-aaa4-1a4ed00fa036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036', 'volume_size': 1} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:26 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9" returned: 0 in 0.306s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2ad5136-fb10-476c-a467-887a6bfeb56e,created_at=2026-07-31T05:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-813430605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2ad5136-fb10-476c-a467-887a6bfeb56e,host='devstack@QuobyteHD#QuobyteHD',id=9ad3afe8-7ebe-4c3a-ac42-cca620339c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4ecc757984212995a46c7799c3d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:26Z,use_quota=True,user_id='f20d8ca66c63424082d4eab3e350a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3df6a524-afd7-4002-b698-24a779ec50dc),volume_type_id=3df6a524-afd7-4002-b698-24a779ec50dc)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Creating volume 9ad3afe8-7ebe-4c3a-ac42-cca620339c3b {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:26 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:26 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b 1073741824 Jul 31 07:32:26 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (bcba8a4a-257f-4417-81b3-af6f49d9cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d50b67-ae1c-4467-9afe-7a52682b7981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2dd8452a-72e8-46fa-80d2-5f85e8772903 tempest-VolumesSnapshotListTestJSON-76977473 None] Create snapshot completed successfully Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d50b67-ae1c-4467-9afe-7a52682b7981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789765260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724d8e78-9079-4db9-8e15-309da240da6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:27Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddf65c0-3a66-47d2-b197-a61f20273627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddf65c0-3a66-47d2-b197-a61f20273627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5902b676-2197-434a-b916-b04a1b82e101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5902b676-2197-434a-b916-b04a1b82e101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724d8e78-9079-4db9-8e15-309da240da6b', 'volume_name': 'volume-724d8e78-9079-4db9-8e15-309da240da6b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771eb9c1-3e9e-42ea-a1af-84f808391027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771eb9c1-3e9e-42ea-a1af-84f808391027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ab7ffc-379a-445e-84f3-555afa6dbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:26 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume 724d8e78-9079-4db9-8e15-309da240da6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724d8e78-9079-4db9-8e15-309da240da6b', 'volume_size': 1} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:26 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (61fa2692-7e63-43cf-8850-0268f2f9eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb35ede-2239-4fd6-a60d-07622d80d82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb35ede-2239-4fd6-a60d-07622d80d82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687161401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766acb17-aba2-4a2a-a7f5-fa163fc72090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:27Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8052ec55-317d-46a6-92bb-098f08f841c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8052ec55-317d-46a6-92bb-098f08f841c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6e005d-8146-4cb5-a1a0-bac4a53eaea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6e005d-8146-4cb5-a1a0-bac4a53eaea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766acb17-aba2-4a2a-a7f5-fa163fc72090', 'volume_name': 'volume-766acb17-aba2-4a2a-a7f5-fa163fc72090', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27256b6b-dcb0-414a-9f23-11a098cca50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27256b6b-dcb0-414a-9f23-11a098cca50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01704170-8806-4534-a245-76aa5de2ad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume 766acb17-aba2-4a2a-a7f5-fa163fc72090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766acb17-aba2-4a2a-a7f5-fa163fc72090', 'volume_size': 1} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:27 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b 1073741824" returned: 0 in 0.581s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:27 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b Jul 31 07:32:27 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (38daa1e5-cfa8-434b-b254-e9928d1cb093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9756ec-2d99-4548-a433-fc6c9ddc3c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9756ec-2d99-4548-a433-fc6c9ddc3c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-824634144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d447b3ec-7de9-4ab5-b455-3e3147fe1d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:27Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac14c210-dd5e-4878-9faf-a71d6c1dd2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac14c210-dd5e-4878-9faf-a71d6c1dd2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c9f828-2143-452d-9145-c7dbdc94c7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c9f828-2143-452d-9145-c7dbdc94c7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd447b3ec-7de9-4ab5-b455-3e3147fe1d3d', 'volume_name': 'volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6236a6e8-ca6e-4dcb-bb7b-cf934ca1fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6236a6e8-ca6e-4dcb-bb7b-cf934ca1fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d5f03e-a8fc-429b-9f96-75925afe6e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume d447b3ec-7de9-4ab5-b455-3e3147fe1d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d', 'volume_size': 1} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.287s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213268709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f7e474-97db-4860-aaa4-1a4ed00fa036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:26Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Creating volume a9f7e474-97db-4860-aaa4-1a4ed00fa036 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:27 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:27 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 1073741824 Jul 31 07:32:27 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5c8c9b-191f-47f3-815f-80df846db796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc14d14-869d-4cce-b23c-7f2efb420ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Volume volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b (9ad3afe8-7ebe-4c3a-ac42-cca620339c3b): created successfully Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc14d14-869d-4cce-b23c-7f2efb420ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Flow 'volume_create_manager' (fe0f15c4-1039-4d20-aa55-3302ea42d25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5e836684-aeff-43e6-aceb-ddcef45eabb5 tempest-GroupsTest-2095321304 None] Created volume successfully. Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (a86c9b06-d7e1-4167-8abd-6e39b90000e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b63bbd-84f3-4401-971e-79863192f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b63bbd-84f3-4401-971e-79863192f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503905673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ab44ba-a304-4080-83da-07b43bea1bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:28Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d626976c-7931-4478-a1a4-3e937f971c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d626976c-7931-4478-a1a4-3e937f971c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58a3a18-10cc-4c10-9596-4000f6700c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58a3a18-10cc-4c10-9596-4000f6700c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ab44ba-a304-4080-83da-07b43bea1bbc', 'volume_name': 'volume-40ab44ba-a304-4080-83da-07b43bea1bbc', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9cf16b-4b29-40ce-9df7-dfa7253c9478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9cf16b-4b29-40ce-9df7-dfa7253c9478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36026ca5-02a3-4693-b350-72951714f4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:27 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume 40ab44ba-a304-4080-83da-07b43bea1bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ab44ba-a304-4080-83da-07b43bea1bbc', 'volume_size': 1} Jul 31 07:32:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:28 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 1073741824" returned: 0 in 0.554s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-c74861e0-5d4c-49c6-b3fe-77c31a399fa9-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-c74861e0-5d4c-49c6-b3fe-77c31a399fa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:28 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 Jul 31 07:32:28 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-quobyte-c74861e0-5d4c-49c6-b3fe-77c31a399fa9" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-c74861e0-5d4c-49c6-b3fe-77c31a399fa9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Deleting offline snapshot c74861e0-5d4c-49c6-b3fe-77c31a399fa9 of volume eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] snapshot_file for this snap is: volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaf28d5-64df-4b6e-af8f-ba2707887e8a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:28 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 Jul 31 07:32:28 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:28 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036" returned: 0 in 0.257s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789765260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724d8e78-9079-4db9-8e15-309da240da6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:27Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Creating volume 724d8e78-9079-4db9-8e15-309da240da6b {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:28 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29e2c2-1ef0-452e-9c9a-b10e6cb4dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910fe169-1e24-405a-8a1a-3b94e56ede1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:28 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b 1073741824 Jul 31 07:32:28 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:28 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 (a9f7e474-97db-4860-aaa4-1a4ed00fa036): created successfully Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910fe169-1e24-405a-8a1a-3b94e56ede1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (d71e75a0-741f-4d43-8d05-ecdd8509533c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-270be407-1f4a-4303-9199-b85b14f8a80b tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created volume successfully. Jul 31 07:32:28 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9" returned: 0 in 0.466s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab785c8-c893-443c-bcf0-d6009728bb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d133c1-2947-4070-806e-d0d4f402acef]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Flow 'volume_create_manager' (e9827a11-754d-475f-b43b-44e3159ef853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4622d013-3f09-4ff3-a4e5-2e2759504853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4622d013-3f09-4ff3-a4e5-2e2759504853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1889500915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2ad5136-fb10-476c-a467-887a6bfeb56e,host='devstack@QuobyteHD#QuobyteHD',id=4a23a314-6769-4a5b-a48f-633f689943dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4ecc757984212995a46c7799c3d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:29Z,use_quota=True,user_id='f20d8ca66c63424082d4eab3e350a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3df6a524-afd7-4002-b698-24a779ec50dc),volume_type_id=3df6a524-afd7-4002-b698-24a779ec50dc)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8667041e-63a7-42cd-85ff-c08e13087c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8667041e-63a7-42cd-85ff-c08e13087c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518f03d6-8eb2-4e88-b63f-ca32c115f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518f03d6-8eb2-4e88-b63f-ca32c115f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a23a314-6769-4a5b-a48f-633f689943dc', 'volume_name': 'volume-4a23a314-6769-4a5b-a48f-633f689943dc', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f25204-990e-4261-a2a6-d8e28bb81640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f25204-990e-4261-a2a6-d8e28bb81640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41afae78-356a-44cf-87ce-c6715cee06e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:29 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Volume 4a23a314-6769-4a5b-a48f-633f689943dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a23a314-6769-4a5b-a48f-633f689943dc', 'volume_size': 1} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:29 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b Jul 31 07:32:29 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:29 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b 1073741824" returned: 0 in 0.730s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:29 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b Jul 31 07:32:29 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:29 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b" returned: 0 in 0.508s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab785c8-c893-443c-bcf0-d6009728bb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:29 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 Jul 31 07:32:29 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:29 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b" returned: 0 in 0.259s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687161401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766acb17-aba2-4a2a-a7f5-fa163fc72090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:27Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Creating volume 766acb17-aba2-4a2a-a7f5-fa163fc72090 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:29 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:29 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 1073741824 Jul 31 07:32:29 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ab7ffc-379a-445e-84f3-555afa6dbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724d8e78-9079-4db9-8e15-309da240da6b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e07abf-b26f-4b8b-bed7-8e7a8ec7a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:29 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume volume-724d8e78-9079-4db9-8e15-309da240da6b (724d8e78-9079-4db9-8e15-309da240da6b): created successfully Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e07abf-b26f-4b8b-bed7-8e7a8ec7a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (bcba8a4a-257f-4417-81b3-af6f49d9cb82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7f109db6-e4d2-4b8c-b98e-2d07af81f7e6 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created volume successfully. Jul 31 07:32:29 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9" returned: 0 in 0.482s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:29 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9 Jul 31 07:32:29 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:30 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 1073741824" returned: 0 in 0.515s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:30 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.c74861e0-5d4c-49c6-b3fe-77c31a399fa9" returned: 0 in 0.321s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:30 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 Jul 31 07:32:30 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-c74861e0-5d4c-49c6-b3fe-77c31a399fa9" released by "_delete_snapshot" :: held 1.914s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" released by "delete_snapshot" :: held 1.945s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Created reservations ['999c8595-b962-487a-bfc5-ed0ee9318845', 'cd393839-6cbe-46ff-8221-950d4226ee83', 'a44e4af6-bb88-4bdc-92f3-6e2305413089', '814c65f6-6b19-4eb3-b2f2-e2e96b3a05c0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Delete snapshot completed successfully. Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9439be9f-47fa-4959-b831-deab1406e01a tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-c74861e0-5d4c-49c6-b3fe-77c31a399fa9-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:30 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090" returned: 0 in 0.311s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.860s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-824634144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d447b3ec-7de9-4ab5-b455-3e3147fe1d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:27Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Creating volume d447b3ec-7de9-4ab5-b455-3e3147fe1d3d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:30 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01704170-8806-4534-a245-76aa5de2ad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766acb17-aba2-4a2a-a7f5-fa163fc72090', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0df202-4d1f-4b5e-9e1f-c1ded5f2b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:30 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d 1073741824 Jul 31 07:32:30 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:30 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 (766acb17-aba2-4a2a-a7f5-fa163fc72090): created successfully Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0df202-4d1f-4b5e-9e1f-c1ded5f2b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (61fa2692-7e63-43cf-8850-0268f2f9eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5f8e91b0-0dfc-498c-aad7-54e0b480769e tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created volume successfully. Jul 31 07:32:30 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d 1073741824" returned: 0 in 0.556s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:31 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d Jul 31 07:32:31 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:31 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d" returned: 0 in 0.259s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.314s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503905673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ab44ba-a304-4080-83da-07b43bea1bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0265025637405bb4186925306f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:28Z,use_quota=True,user_id='2698c691d99f4389b8d4bfa496321a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Creating volume 40ab44ba-a304-4080-83da-07b43bea1bbc {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:31 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:31 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc 1073741824 Jul 31 07:32:31 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d5f03e-a8fc-429b-9f96-75925afe6e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a33c79-13fe-49ac-9ff1-2a3a5e51af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:31 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d (d447b3ec-7de9-4ab5-b455-3e3147fe1d3d): created successfully Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a33c79-13fe-49ac-9ff1-2a3a5e51af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (38daa1e5-cfa8-434b-b254-e9928d1cb093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:31 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-93bafd14-32c7-4734-ac62-af54431084c7 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created volume successfully. Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-f3404cb5-63c6-43e2-9641-251141eed06b-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-f3404cb5-63c6-43e2-9641-251141eed06b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-quobyte-f3404cb5-63c6-43e2-9641-251141eed06b" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-f3404cb5-63c6-43e2-9641-251141eed06b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Deleting offline snapshot f3404cb5-63c6-43e2-9641-251141eed06b of volume eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] snapshot_file for this snap is: volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e314be41-8c07-4e42-84e7-2365074ebee4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:31 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b Jul 31 07:32:31 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:31 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc 1073741824" returned: 0 in 0.553s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:31 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc Jul 31 07:32:31 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:31 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b" returned: 0 in 0.402s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab785c8-c893-443c-bcf0-d6009728bb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb885e6-36a8-4007-b4f6-3b3743511bfa]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:32 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded Jul 31 07:32:32 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:32 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.159s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2ad5136-fb10-476c-a467-887a6bfeb56e,created_at=2026-07-31T05:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1889500915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2ad5136-fb10-476c-a467-887a6bfeb56e,host='devstack@QuobyteHD#QuobyteHD',id=4a23a314-6769-4a5b-a48f-633f689943dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4ecc757984212995a46c7799c3d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:29Z,use_quota=True,user_id='f20d8ca66c63424082d4eab3e350a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3df6a524-afd7-4002-b698-24a779ec50dc),volume_type_id=3df6a524-afd7-4002-b698-24a779ec50dc)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Creating volume 4a23a314-6769-4a5b-a48f-633f689943dc {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:32 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36026ca5-02a3-4693-b350-72951714f4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ab44ba-a304-4080-83da-07b43bea1bbc', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:32 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc 1073741824 Jul 31 07:32:32 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783058bf-d342-4be2-b65f-f25f02511a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:32 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Volume volume-40ab44ba-a304-4080-83da-07b43bea1bbc (40ab44ba-a304-4080-83da-07b43bea1bbc): created successfully Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783058bf-d342-4be2-b65f-f25f02511a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Flow 'volume_create_manager' (a86c9b06-d7e1-4167-8abd-6e39b90000e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:32 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-93c87a8f-d03e-4b59-a1b0-a6bde0a7d7ab tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created volume successfully. Jul 31 07:32:32 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded" returned: 0 in 0.416s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab785c8-c893-443c-bcf0-d6009728bb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:32 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b Jul 31 07:32:32 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-40ab44ba-a304-4080-83da-07b43bea1bbc-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-40ab44ba-a304-4080-83da-07b43bea1bbc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-40ab44ba-a304-4080-83da-07b43bea1bbc" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-40ab44ba-a304-4080-83da-07b43bea1bbc" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[52143c9f-6776-41d9-89b6-924b21f4c1ba]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:32 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc Jul 31 07:32:32 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:32 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc 1073741824" returned: 0 in 0.658s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:32 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc Jul 31 07:32:32 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:33 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b" returned: 0 in 0.647s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:33 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b Jul 31 07:32:33 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:33 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc" returned: 0 in 0.633s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:33 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc" returned: 0 in 0.499s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:33 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc Jul 31 07:32:33 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41afae78-356a-44cf-87ce-c6715cee06e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a23a314-6769-4a5b-a48f-633f689943dc', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691ced48-9215-4a4b-8c60-88c2cd3b5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:33 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Volume volume-4a23a314-6769-4a5b-a48f-633f689943dc (4a23a314-6769-4a5b-a48f-633f689943dc): created successfully Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691ced48-9215-4a4b-8c60-88c2cd3b5751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Flow 'volume_create_manager' (e9827a11-754d-475f-b43b-44e3159ef853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-94add89c-0706-4c62-82e5-40df76081c28 tempest-GroupsTest-2095321304 None] Created volume successfully. Jul 31 07:32:33 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.f3404cb5-63c6-43e2-9641-251141eed06b" returned: 0 in 0.503s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-f3404cb5-63c6-43e2-9641-251141eed06b" released by "_delete_snapshot" :: held 2.115s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" released by "delete_snapshot" :: held 2.145s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:33 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:33 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Created reservations ['38a77654-4b12-4bb6-bf02-e8b9b724579a', '80e23a1c-300a-4522-80f3-65c8484ef6a0', '1a305179-edd8-49f7-979a-14eb94fcb1c8', 'd0ca43a1-1994-495a-b6d2-4d09e7f4bba5'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:33 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40ab44ba-a304-4080-83da-07b43bea1bbc" returned: 0 in 0.514s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-40ab44ba-a304-4080-83da-07b43bea1bbc" released by "delete_volume" :: held 1.216s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-6660c8c3-62b1-4493-865a-481c0e93868c req-a9952e73-3529-4e12-910b-d065023758dc tempest-TestShelveInstance-340392848 None] Terminate volume connection completed successfully. Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-6660c8c3-62b1-4493-865a-481c0e93868c req-a9952e73-3529-4e12-910b-d065023758dc tempest-TestShelveInstance-340392848 None] Deleting attachment 45a77e8c-0cde-47e4-85f4-af916d1d3ed5. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:32:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Delete snapshot completed successfully. Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af48d2ec-62e8-402d-9e5c-bf60087e4de9 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-f3404cb5-63c6-43e2-9641-251141eed06b-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created reservations ['69d8e17d-f063-4f1d-ad85-a76f8a6c9504', '412a724c-0020-496e-84d5-481a0ae238a4', '96b9dc7e-649a-48d2-8ebf-09582598ff3f', '72c91cb3-6fc3-4f76-a85d-96f1308ff3b0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:34 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.372s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:32:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ba1332c3-5059-404c-9a4d-0cd60d4f7d97 tempest-GroupsTest-2095321304 None] Update group completed successfully. Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:34 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:34 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:34 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.261s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Deleted volume successfully. Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9437829e-35c4-4909-810f-dd8364879479 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-40ab44ba-a304-4080-83da-07b43bea1bbc-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-763c2123-aa5f-47e6-9351-c88ac2132ded-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-763c2123-aa5f-47e6-9351-c88ac2132ded-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-quobyte-763c2123-aa5f-47e6-9351-c88ac2132ded" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-763c2123-aa5f-47e6-9351-c88ac2132ded" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Deleting offline snapshot 763c2123-aa5f-47e6-9351-c88ac2132ded of volume eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] snapshot_file for this snap is: volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1800e31f-99c8-459c-9d82-ef59cfea14e6]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:34 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded Jul 31 07:32:34 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0901f0f5-269a-44af-b3bb-229d3566ffaf]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:35 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d Jul 31 07:32:35 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:35 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded" returned: 0 in 0.482s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab785c8-c893-443c-bcf0-d6009728bb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f45367f-6567-473b-8cc5-8766f8eb3c13]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:35 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 Jul 31 07:32:35 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6fca74c7-a94e-4e0d-8e0a-740a60b3af57 tempest-GroupsTest-2095321304 None] Update group completed successfully. Jul 31 07:32:35 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d" returned: 0 in 0.538s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:35 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d Jul 31 07:32:35 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:35 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14" returned: 0 in 0.488s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:35 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded Jul 31 07:32:35 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:35 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d" returned: 0 in 0.320s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d" released by "delete_volume" :: held 0.906s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=141,cinder:UPDATE=141,cinder:INSERT=32,cinder:DELETE=9 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=132,cinder:INSERT=42,cinder:UPDATE=142,cinder:DELETE=15 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:32:35 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created reservations ['a170e6f6-acb5-4614-ba68-8dd4477b73e2', '446a2cdd-169d-4803-88e5-fac6e64e557c', '78aa8d9d-d1e4-43b4-a58d-8dc119a38187', '9c072244-6b5e-4dc2-88d1-7cc3fa0773c6'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:36 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:36 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-766acb17-aba2-4a2a-a7f5-fa163fc72090-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-766acb17-aba2-4a2a-a7f5-fa163fc72090-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-766acb17-aba2-4a2a-a7f5-fa163fc72090" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-766acb17-aba2-4a2a-a7f5-fa163fc72090" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f052f073-3e2e-40f9-9c88-b6287c8d7baa]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:36 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded" returned: 0 in 0.503s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:36 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded Jul 31 07:32:36 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:36 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 Jul 31 07:32:36 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:36 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Deleted volume successfully. Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3e3b6184-9297-425f-b144-a2e3b866cf73 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-d447b3ec-7de9-4ab5-b455-3e3147fe1d3d-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:36 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14.763c2123-aa5f-47e6-9351-c88ac2132ded" returned: 0 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:36 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090" returned: 0 in 0.503s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-763c2123-aa5f-47e6-9351-c88ac2132ded" released by "_delete_snapshot" :: held 1.990s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" released by "delete_snapshot" :: held 2.014s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:36 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090 Jul 31 07:32:36 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-63dc65db-247a-4fc1-9a5c-1b0bc4f31843 req-03595d15-c56e-42d3-a0a8-544593b0b7a1 tempest-TestShelveInstance-340392848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-63dc65db-247a-4fc1-9a5c-1b0bc4f31843 req-03595d15-c56e-42d3-a0a8-544593b0b7a1 tempest-TestShelveInstance-340392848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-63dc65db-247a-4fc1-9a5c-1b0bc4f31843 req-03595d15-c56e-42d3-a0a8-544593b0b7a1 tempest-TestShelveInstance-340392848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Created reservations ['ba90babb-dc0f-4ff6-8640-cf9e58ec7a88', 'cb8fdbaa-db1f-4015-a628-dc649de74076', 'b40aa86b-f7ba-4d80-a495-d3556a164a4c', '436364c0-bfaf-423e-b1f1-e33f022e1a5b'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-63dc65db-247a-4fc1-9a5c-1b0bc4f31843 req-03595d15-c56e-42d3-a0a8-544593b0b7a1 tempest-TestShelveInstance-340392848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-2ee05502-293b-43db-8ca2-2a10196edd32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0b44214-303c-43a7-872d-234cb01e0923', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:32:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-63dc65db-247a-4fc1-9a5c-1b0bc4f31843 req-03595d15-c56e-42d3-a0a8-544593b0b7a1 tempest-TestShelveInstance-340392848 None] attachment_update completed successfully. Jul 31 07:32:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Delete snapshot completed successfully. Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a8e9e88b-09b1-4038-82ff-feb08b27588d tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-763c2123-aa5f-47e6-9351-c88ac2132ded-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:37 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-766acb17-aba2-4a2a-a7f5-fa163fc72090" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-766acb17-aba2-4a2a-a7f5-fa163fc72090" released by "delete_volume" :: held 0.920s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created reservations ['62c961a0-3a76-4ff7-b484-8f939b114fbd', '33556d76-6cb1-4a6d-8f40-316df27b161f', 'e93be752-81e5-466a-9d1a-23e2e6c9436b', '0168a75e-5fe5-494e-8bc7-6bf4f712d98e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Acquiring lock "cinder-quobyte-4a23a314-6769-4a5b-a48f-633f689943dc" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:37 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:37 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Lock "cinder-quobyte-4a23a314-6769-4a5b-a48f-633f689943dc" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-724d8e78-9079-4db9-8e15-309da240da6b-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4d2c50-3a47-485e-9a19-f6bac91a31df]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-724d8e78-9079-4db9-8e15-309da240da6b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-724d8e78-9079-4db9-8e15-309da240da6b" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-724d8e78-9079-4db9-8e15-309da240da6b" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3537fc-a01a-489c-926c-e6b6dcfe48dd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:37 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc Jul 31 07:32:37 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:37 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.361s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Deleted volume successfully. Jul 31 07:32:37 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b Jul 31 07:32:37 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d34b08dc-9c2d-4e45-838b-cf1850d9e069 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-766acb17-aba2-4a2a-a7f5-fa163fc72090-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:37 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc" returned: 0 in 0.551s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:38 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc Jul 31 07:32:38 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-eab785c8-c893-443c-bcf0-d6009728bb14-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:38 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b" returned: 0 in 0.520s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-eab785c8-c893-443c-bcf0-d6009728bb14-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:38 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b Jul 31 07:32:38 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f623f-3e37-464f-b8fd-c7a943556d10]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:38 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-4a23a314-6769-4a5b-a48f-633f689943dc" returned: 0 in 0.379s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Lock "cinder-quobyte-4a23a314-6769-4a5b-a48f-633f689943dc" released by "delete_volume" :: held 1.020s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Acquiring lock "cinder-quobyte-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Lock "cinder-quobyte-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:38 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 Jul 31 07:32:38 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68bf745-8a02-415d-9211-c47a314bb659]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:38 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-724d8e78-9079-4db9-8e15-309da240da6b" returned: 0 in 0.415s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-724d8e78-9079-4db9-8e15-309da240da6b" released by "delete_volume" :: held 0.995s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:38 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b Jul 31 07:32:38 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created reservations ['ea3f3a9e-06e4-4552-ac71-c404c2f0a341', '1d5c7f72-a289-4475-811d-e43846673d53', 'd365347a-0449-484c-a832-0890a9ccd71f', '58179db6-7907-4dfa-89aa-1c8de14bcc14'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:38 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14" returned: 0 in 0.549s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:38 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14 Jul 31 07:32:38 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:38 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:38 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:39 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b" returned: 0 in 0.556s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:39 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b Jul 31 07:32:39 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:39 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eab785c8-c893-443c-bcf0-d6009728bb14" returned: 0 in 0.293s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:39 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.329s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-quobyte-eab785c8-c893-443c-bcf0-d6009728bb14" released by "delete_volume" :: held 0.933s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:39 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Deleted volume successfully. Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e16a01c1-9625-4625-8296-b5a401ab56ca tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-724d8e78-9079-4db9-8e15-309da240da6b-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Created reservations ['2ef9e0aa-b6d5-4a90-af25-fccedb9d334d', 'b75b53a2-2e87-4881-afd7-0414602404d5', '64980474-4dc9-4b6f-a7cf-df8454ee7cb6', '434d9656-5ef3-452f-845e-74f99b19d815'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:39 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b" returned: 0 in 0.333s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Lock "cinder-quobyte-9ad3afe8-7ebe-4c3a-ac42-cca620339c3b" released by "delete_volume" :: held 0.934s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:39 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:39 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Created reservations ['93d77e2b-3a2a-4063-a640-83a2b358bbdb'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:39 devstack cinder-volume[88915]: WARNING cinder.quota [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1663069744 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1663069744, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:32:39 devstack cinder-volume[88915]: WARNING cinder.quota [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1663069744 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1663069744, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Created reservations ['72cb1374-3115-43d2-b010-8e3846baab3d', '98c3b212-a3d2-43cf-b54c-465b1d49a575', '2fc07f88-0cf9-42fe-a9dd-d62f4f907b6f', 'dbce5ac1-58d3-4e41-9225-b86c85a457fc'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:39 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.305s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:39 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Deleted volume successfully. Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Created reservations ['75e0722f-6392-4fb3-9b98-ad114856dad5', '229d16cd-6711-44db-8f7d-144aca37e266', 'ba9aa54b-52fa-49a8-9273-532ecc803370', 'cde359d4-d33c-475b-916e-7fdab9da1681'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-72c78bb4-0ad1-4c7b-aee5-a93530cd9671 tempest-VolumesSnapshotListTestJSON-76977473 None] Lock "cinder-eab785c8-c893-443c-bcf0-d6009728bb14-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-a9f7e474-97db-4860-aaa4-1a4ed00fa036-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-a9f7e474-97db-4860-aaa4-1a4ed00fa036-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-a9f7e474-97db-4860-aaa4-1a4ed00fa036" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-a9f7e474-97db-4860-aaa4-1a4ed00fa036" acquired by "delete_volume" :: waited 0.051s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:39 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:39 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dc9e9c-9ab5-4f78-acef-daa5dc896600]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:40 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 Jul 31 07:32:40 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:40 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.280s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:40 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:40 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-144ff916-af80-46ac-b2f2-beb4730f249c tempest-GroupsTest-2095321304 None] Delete group completed successfully. Jul 31 07:32:40 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036" returned: 0 in 0.450s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:40 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036 Jul 31 07:32:40 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:40 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9f7e474-97db-4860-aaa4-1a4ed00fa036" returned: 0 in 0.489s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-a9f7e474-97db-4860-aaa4-1a4ed00fa036" released by "delete_volume" :: held 1.024s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created reservations ['02cfc039-263e-440d-aee8-e581c38d385c', '1d1b572f-f16b-4eb2-aa3e-eb94f4f5aef2', 'f9574124-4bd7-45ee-b236-5e5c7a422556', 'fd852efe-2b39-4b32-8f2f-07a9c73b051d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:41 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:41 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:41 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.449s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:41 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Deleted volume successfully. Jul 31 07:32:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-43f4bc3f-7ce7-4727-8d37-a40c4841fb51 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-a9f7e474-97db-4860-aaa4-1a4ed00fa036-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-21c4fb4b-2b29-4675-88d2-48b43072b467-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-21c4fb4b-2b29-4675-88d2-48b43072b467-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-fa6319ba-180d-40de-8f7e-7e2803d7b733" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-fa6319ba-180d-40de-8f7e-7e2803d7b733" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-21c4fb4b-2b29-4675-88d2-48b43072b467" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-21c4fb4b-2b29-4675-88d2-48b43072b467" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Deleting offline snapshot 21c4fb4b-2b29-4675-88d2-48b43072b467 of volume fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] snapshot_file for this snap is: volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[479e8ac4-5580-4dcd-8a0c-36e8cbb1d8dc]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:42 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 Jul 31 07:32:42 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:42 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467" returned: 0 in 0.490s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6319ba-180d-40de-8f7e-7e2803d7b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1ca0c0-613b-4865-8d29-10d041186dc9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:43 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 Jul 31 07:32:43 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:43 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733" returned: 0 in 0.623s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:43 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 Jul 31 07:32:43 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:44 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467" returned: 0 in 0.611s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:44 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467 Jul 31 07:32:44 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:44 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733.21c4fb4b-2b29-4675-88d2-48b43072b467" returned: 0 in 0.536s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-21c4fb4b-2b29-4675-88d2-48b43072b467" released by "_delete_snapshot" :: held 2.522s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-fa6319ba-180d-40de-8f7e-7e2803d7b733" released by "delete_snapshot" :: held 2.572s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:44 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created reservations ['0b85a3f9-88d9-4a14-a906-0687629b5c71', '15d96c70-92bd-4320-8a3f-1c5c50fc2a64', 'ee098709-fa22-4238-bf3d-798404d712f1', '9ffe2e16-18b1-484e-9f01-03e03f934f5f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Delete snapshot completed successfully. Jul 31 07:32:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e617041c-f382-4693-9bf1-659c2ae85b61 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-21c4fb4b-2b29-4675-88d2-48b43072b467-delete_snapshot" released by "delete_snapshot" :: held 2.834s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-fa6319ba-180d-40de-8f7e-7e2803d7b733-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-fa6319ba-180d-40de-8f7e-7e2803d7b733-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "cinder-quobyte-fa6319ba-180d-40de-8f7e-7e2803d7b733" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-fa6319ba-180d-40de-8f7e-7e2803d7b733" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:45 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc930639-8272-488a-bc9d-31262a23f9e0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:45 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 Jul 31 07:32:45 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Flow 'volume_create_manager' (36fccc41-93e4-457a-840b-2cd820d7fdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7219d8-e894-45c5-916d-c5f824d61a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7219d8-e894-45c5-916d-c5f824d61a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1031951880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697636f0-f7b1-40c6-ab6d-49e0964356c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6113028dbe2441387dfc10f2615c295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:46Z,use_quota=True,user_id='02ce9dbdc33c4301b5cbfa5968bab841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6610e65-5ba3-45fb-bf52-04d8d8552e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6610e65-5ba3-45fb-bf52-04d8d8552e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0973a25b-5254-432d-8def-706cd8cb48fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0973a25b-5254-432d-8def-706cd8cb48fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697636f0-f7b1-40c6-ab6d-49e0964356c6', 'volume_name': 'volume-697636f0-f7b1-40c6-ab6d-49e0964356c6', 'volume_size': 2}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b7148e-690c-40aa-8130-de2c4733ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b7148e-690c-40aa-8130-de2c4733ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f62989-c769-485f-ac69-d7e68f7f9bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Volume 697636f0-f7b1-40c6-ab6d-49e0964356c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697636f0-f7b1-40c6-ab6d-49e0964356c6', 'volume_size': 2} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1031951880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697636f0-f7b1-40c6-ab6d-49e0964356c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6113028dbe2441387dfc10f2615c295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:46Z,use_quota=True,user_id='02ce9dbdc33c4301b5cbfa5968bab841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Creating volume 697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:46 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 2147483648 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:46 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 2147483648 Jul 31 07:32:46 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:46 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733" returned: 0 in 0.661s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:46 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733 Jul 31 07:32:46 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:46 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fa6319ba-180d-40de-8f7e-7e2803d7b733" returned: 0 in 0.366s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-quobyte-fa6319ba-180d-40de-8f7e-7e2803d7b733" released by "delete_volume" :: held 1.121s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Created reservations ['ff025b97-5590-4b2a-8552-1efdcbb9d600', 'c64050f3-bd73-49fd-82c7-d92dde6e9cf2', 'ffe6aa48-5203-408d-b340-06888048798e', '31785a87-747a-4a48-8225-9a9888dd7bb4'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:46 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 2147483648" returned: 0 in 0.702s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:46 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 Jul 31 07:32:46 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:47 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:47 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:47 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6" returned: 0 in 0.336s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f62989-c769-485f-ac69-d7e68f7f9bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697636f0-f7b1-40c6-ab6d-49e0964356c6', 'volume_size': 2}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:47 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0463398-7373-4b7d-8bfb-0309898e4ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.303s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Deleted volume successfully. Jul 31 07:32:47 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Volume volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 (697636f0-f7b1-40c6-ab6d-49e0964356c6): created successfully Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0463398-7373-4b7d-8bfb-0309898e4ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Flow 'volume_create_manager' (36fccc41-93e4-457a-840b-2cd820d7fdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-15eb4a05-4af3-4f74-a99e-2037fddbac37 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Created volume successfully. Jul 31 07:32:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-39fa91d1-c65b-4489-9e40-e82ae7265d25 tempest-CreateVolumesFromSnapshotTest-1572958331 None] Lock "cinder-fa6319ba-180d-40de-8f7e-7e2803d7b733-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Creating offline snapshot 486527f8-1d23-4e12-bea2-7f06d01ca5ce of volume 697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:32:48 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa76e37-644d-4768-a11c-033ffd3768b2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:48 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 Jul 31 07:32:48 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b2a23be2-14cd-4f06-b462-c67c27dbf895 tempest-GroupsV320Test-2107675111 None] Group tempest-GroupsV320Test-Group-1736388873: creating Jul 31 07:32:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b2a23be2-14cd-4f06-b462-c67c27dbf895 tempest-GroupsV320Test-2107675111 None] Group tempest-GroupsV320Test-Group-1736388873: created successfully Jul 31 07:32:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b2a23be2-14cd-4f06-b462-c67c27dbf895 tempest-GroupsV320Test-2107675111 None] Create group completed successfully. Jul 31 07:32:49 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6" returned: 0 in 0.508s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce 2G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:49 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce 2G Jul 31 07:32:49 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:49 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce 2G" returned: 0 in 0.512s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:49 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce Jul 31 07:32:49 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:49 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:49 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce is being set with open permissions: ugo+rw Jul 31 07:32:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:50 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce Jul 31 07:32:50 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:50 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:50 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.info Jul 31 07:32:50 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Created reservations ['86c47d34-b9fc-4a3c-8580-ec390957d8d1'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:50 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:50 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:50 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.info" returned: 0 in 0.399s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:50 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.info is being set with open permissions: ugo+rw Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:50 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.info Jul 31 07:32:50 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:50 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2e228a1e-cf73-46ec-aece-0f014a249796 tempest-GroupsV320Test-2107675111 None] Delete group completed successfully. Jul 31 07:32:50 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.info" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-58be7caf-6dcf-44e2-94f1-691326760604 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Create snapshot completed successfully Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Flow 'volume_create_manager' (e1626051-9440-498c-b625-db3a1f9eb2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b1cf24-cb56-41df-9e3f-25782225466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b1cf24-cb56-41df-9e3f-25782225466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2843a14c-bcb4-4821-b1d8-811f5e99406b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f56dffe14524837811cb5edbfaac349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:51Z,use_quota=True,user_id='3dc957b7b23a4d91b3689222f7d09e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058a42d1-d63f-4e8b-8f8c-b67bca807b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058a42d1-d63f-4e8b-8f8c-b67bca807b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4f9333-e59e-4c1f-bda1-ded69267c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4f9333-e59e-4c1f-bda1-ded69267c844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2843a14c-bcb4-4821-b1d8-811f5e99406b', 'volume_name': 'volume-2843a14c-bcb4-4821-b1d8-811f5e99406b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74904a09-318e-4e10-be5d-2a0d4aaec794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74904a09-318e-4e10-be5d-2a0d4aaec794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ca309b-8c47-41c4-9ae0-ce2c89fa73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:51 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Volume 2843a14c-bcb4-4821-b1d8-811f5e99406b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2843a14c-bcb4-4821-b1d8-811f5e99406b', 'volume_size': 1} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2843a14c-bcb4-4821-b1d8-811f5e99406b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f56dffe14524837811cb5edbfaac349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:51Z,use_quota=True,user_id='3dc957b7b23a4d91b3689222f7d09e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Creating volume 2843a14c-bcb4-4821-b1d8-811f5e99406b {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:51 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:51 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b 1073741824 Jul 31 07:32:51 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "cinder-486527f8-1d23-4e12-bea2-7f06d01ca5ce-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-486527f8-1d23-4e12-bea2-7f06d01ca5ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "cinder-quobyte-697636f0-f7b1-40c6-ab6d-49e0964356c6" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-quobyte-697636f0-f7b1-40c6-ab6d-49e0964356c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "cinder-quobyte-486527f8-1d23-4e12-bea2-7f06d01ca5ce" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-quobyte-486527f8-1d23-4e12-bea2-7f06d01ca5ce" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Deleting offline snapshot 486527f8-1d23-4e12-bea2-7f06d01ca5ce of volume 697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] snapshot_file for this snap is: volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa5a0d-1909-4d64-be2c-27d129471413]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:52 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce Jul 31 07:32:52 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:52 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b 1073741824" returned: 0 in 0.576s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:52 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b Jul 31 07:32:52 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:52 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697636f0-f7b1-40c6-ab6d-49e0964356c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46e9891-4d79-4bf8-931e-c9883317734c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:52 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 Jul 31 07:32:52 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:52 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b" returned: 0 in 0.424s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ca309b-8c47-41c4-9ae0-ce2c89fa73d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2843a14c-bcb4-4821-b1d8-811f5e99406b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b6cac-e323-449e-b731-bfc61c2fb9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:52 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Volume volume-2843a14c-bcb4-4821-b1d8-811f5e99406b (2843a14c-bcb4-4821-b1d8-811f5e99406b): created successfully Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b6cac-e323-449e-b731-bfc61c2fb9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Flow 'volume_create_manager' (e1626051-9440-498c-b625-db3a1f9eb2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:52 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-aa032de3-ea4c-4885-aa5f-a62e402d207f tempest-CinderUnicodeTest-368144032 None] Created volume successfully. Jul 31 07:32:52 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6" returned: 0 in 0.458s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:52 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce Jul 31 07:32:52 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:53 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce" returned: 0 in 0.403s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:53 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce Jul 31 07:32:53 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:53 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6.486527f8-1d23-4e12-bea2-7f06d01ca5ce" returned: 0 in 0.303s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-quobyte-486527f8-1d23-4e12-bea2-7f06d01ca5ce" released by "_delete_snapshot" :: held 1.778s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-quobyte-697636f0-f7b1-40c6-ab6d-49e0964356c6" released by "delete_snapshot" :: held 1.821s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:53 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Created reservations ['d108a7f4-6e36-4917-96a1-0e04c28f37f4', '2dfdf53c-4fb6-4bf3-9e2e-c9f5078fd4df', '7f55c0c8-567d-4717-aec0-6558d19379e9', '39a43fa5-f05a-4ec6-a7d6-99bb5e23be0f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Delete snapshot completed successfully. Jul 31 07:32:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-2a303622-6558-4ee0-8196-710d25c8a0e8 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-486527f8-1d23-4e12-bea2-7f06d01ca5ce-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "cinder-697636f0-f7b1-40c6-ab6d-49e0964356c6-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-697636f0-f7b1-40c6-ab6d-49e0964356c6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "cinder-quobyte-697636f0-f7b1-40c6-ab6d-49e0964356c6" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-quobyte-697636f0-f7b1-40c6-ab6d-49e0964356c6" acquired by "delete_volume" :: waited 0.048s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d548f6b-77f0-453b-a9e7-b3ba3f21ae9b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Flow 'volume_create_manager' (7c14c00d-c9d4-4cc1-ba8f-d70744259902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:54 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 Jul 31 07:32:54 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857abde7-e1e7-411a-817f-e8f09dcc3a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857abde7-e1e7-411a-817f-e8f09dcc3a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1191090554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde9c9c7-4c93-4baf-9293-a9da0ead3fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f56dffe14524837811cb5edbfaac349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:54Z,use_quota=True,user_id='3dc957b7b23a4d91b3689222f7d09e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04055da8-c44d-4449-89fa-34f26d95bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04055da8-c44d-4449-89fa-34f26d95bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3611d947-4b58-4405-8d39-268c1efc27d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3611d947-4b58-4405-8d39-268c1efc27d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde9c9c7-4c93-4baf-9293-a9da0ead3fb2', 'volume_name': 'volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acfd970-5913-4665-8188-cb1ecc5d8aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acfd970-5913-4665-8188-cb1ecc5d8aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0bb093-9b77-4433-8afe-4ff8d29536d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:54 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Volume dde9c9c7-4c93-4baf-9293-a9da0ead3fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2', 'volume_size': 1} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1191090554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde9c9c7-4c93-4baf-9293-a9da0ead3fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f56dffe14524837811cb5edbfaac349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:54Z,use_quota=True,user_id='3dc957b7b23a4d91b3689222f7d09e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Creating volume dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:54 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:54 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 1073741824 Jul 31 07:32:54 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:54 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6" returned: 0 in 0.601s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:55 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6 Jul 31 07:32:55 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:55 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 1073741824" returned: 0 in 0.633s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:55 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-697636f0-f7b1-40c6-ab6d-49e0964356c6" returned: 0 in 0.380s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-quobyte-697636f0-f7b1-40c6-ab6d-49e0964356c6" released by "delete_volume" :: held 1.098s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:55 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 Jul 31 07:32:55 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Created reservations ['b95c26fe-2528-486f-8481-738e2f83d9eb', 'fb307cab-dd7d-4639-ad82-005887acdc41', '029705fa-8887-49ba-8193-31985dba092a', '35da0a5a-f80a-4875-af0a-cf4cdcb4c816'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:55 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:32:55 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:55 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" returned: 0 in 0.343s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0bb093-9b77-4433-8afe-4ff8d29536d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573a1938-a89a-4c77-b481-6a2bfde439d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:55 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Volume volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 (dde9c9c7-4c93-4baf-9293-a9da0ead3fb2): created successfully Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573a1938-a89a-4c77-b481-6a2bfde439d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Flow 'volume_create_manager' (7c14c00d-c9d4-4cc1-ba8f-d70744259902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1e47ae4a-a318-46bc-8ad8-027273dd3f5c tempest-CinderUnicodeTest-368144032 None] Created volume successfully. Jul 31 07:32:55 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.368s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:32:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Deleted volume successfully. Jul 31 07:32:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5c9b70ec-33c8-4267-b229-ca2ce8a106c9 tempest-VolumesSnapshotNegativeTestJSON-1116532815 None] Lock "cinder-697636f0-f7b1-40c6-ab6d-49e0964356c6-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:32:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Creating offline snapshot 671662b8-4969-40a5-ac81-92d51190ee9e of volume dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:32:57 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667d555-4059-40ff-8464-11b39860358a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:32:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:57 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 Jul 31 07:32:57 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:57 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" returned: 0 in 0.527s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:57 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e 1G Jul 31 07:32:57 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:32:58 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Flow 'volume_create_manager' (e084d50b-faa3-40b1-8133-8854d509ef4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff24d228-7257-4881-897d-0eaa7bcb0e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e 1G" returned: 0 in 0.710s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff24d228-7257-4881-897d-0eaa7bcb0e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-946507215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759c3af4-773b-4e72-8299-bcbcbf143957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937c734d86fa4968b2646637c0b43437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:58Z,use_quota=True,user_id='c4638e4148b74ea49f69225ebe4d49cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:58 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baad493b-3908-4e5a-9819-c212ce1bec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:58 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baad493b-3908-4e5a-9819-c212ce1bec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145d3da3-7764-4dba-94db-bd80459484dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145d3da3-7764-4dba-94db-bd80459484dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759c3af4-773b-4e72-8299-bcbcbf143957', 'volume_name': 'volume-759c3af4-773b-4e72-8299-bcbcbf143957', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a74f98-97bd-4958-816b-3b50696bf88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a74f98-97bd-4958-816b-3b50696bf88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33016204-b162-45a9-8f87-406f2d452be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:32:58 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Volume 759c3af4-773b-4e72-8299-bcbcbf143957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759c3af4-773b-4e72-8299-bcbcbf143957', 'volume_size': 1} Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:58 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e" returned: 0 in 0.412s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:58 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e is being set with open permissions: ugo+rw Jul 31 07:32:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:58 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e Jul 31 07:32:58 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:59 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:59 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.info Jul 31 07:32:59 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:59 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.info" returned: 0 in 0.318s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:59 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.info is being set with open permissions: ugo+rw Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:59 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.info Jul 31 07:32:59 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:59 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.info" returned: 0 in 0.259s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-946507215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759c3af4-773b-4e72-8299-bcbcbf143957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937c734d86fa4968b2646637c0b43437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:32:58Z,use_quota=True,user_id='c4638e4148b74ea49f69225ebe4d49cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Creating volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:32:59 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:32:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:32:59 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 1073741824 Jul 31 07:32:59 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:32:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a7fa2c45-9f45-47d8-9b55-0bb3cd516ef5 tempest-CinderUnicodeTest-368144032 None] Create snapshot completed successfully Jul 31 07:33:00 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 1073741824" returned: 0 in 0.466s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:00 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 Jul 31 07:33:00 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Acquiring lock "cinder-671662b8-4969-40a5-ac81-92d51190ee9e-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Lock "cinder-671662b8-4969-40a5-ac81-92d51190ee9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Acquiring lock "cinder-quobyte-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Acquiring lock "cinder-quobyte-671662b8-4969-40a5-ac81-92d51190ee9e" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-671662b8-4969-40a5-ac81-92d51190ee9e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Deleting offline snapshot 671662b8-4969-40a5-ac81-92d51190ee9e of volume dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] snapshot_file for this snap is: volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4501bf3-b011-46e2-801e-5145165f8db6]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:00 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e Jul 31 07:33:00 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:00 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33016204-b162-45a9-8f87-406f2d452be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759c3af4-773b-4e72-8299-bcbcbf143957', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf22318-4766-4a85-b841-4ce3e0e6b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:00 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Volume volume-759c3af4-773b-4e72-8299-bcbcbf143957 (759c3af4-773b-4e72-8299-bcbcbf143957): created successfully Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf22318-4766-4a85-b841-4ce3e0e6b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Flow 'volume_create_manager' (e084d50b-faa3-40b1-8133-8854d509ef4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:00 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4a93e81d-db0b-424a-9d86-5a007f39d0e9 tempest-SnapshotsActionsTest-1890532004 None] Created volume successfully. Jul 31 07:33:00 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e" returned: 0 in 0.402s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b10679-a05f-4773-94da-60e715c5b31a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:00 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 Jul 31 07:33:00 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:01 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" returned: 0 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:01 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e Jul 31 07:33:01 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:01 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e" returned: 0 in 0.418s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:01 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e Jul 31 07:33:01 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Creating offline snapshot 7ef06821-765b-4c1d-838a-4cde8aff9891 of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782b305-fc63-4379-99e4-f66937b32300]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:01 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 Jul 31 07:33:01 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:01 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2.671662b8-4969-40a5-ac81-92d51190ee9e" returned: 0 in 0.293s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-671662b8-4969-40a5-ac81-92d51190ee9e" released by "_delete_snapshot" :: held 1.652s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" released by "delete_snapshot" :: held 1.682s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Created reservations ['1a42820d-46c9-4e3c-9551-c8b45088bbd0', '1cd2c0e6-8f5a-4701-8d7c-7d956c30ded6', 'f0891681-c438-477d-841b-e62cb061635e', 'f625cc1b-2505-4134-9d7f-b41ff1acffd3'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Delete snapshot completed successfully. Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-12b943bc-9e87-4139-9cf3-d4bff921713f tempest-CinderUnicodeTest-368144032 None] Lock "cinder-671662b8-4969-40a5-ac81-92d51190ee9e-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:02 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957" returned: 0 in 0.441s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:02 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 1G Jul 31 07:33:02 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Acquiring lock "cinder-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Acquiring lock "cinder-quobyte-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a87691-e6f4-4bb2-9923-dd18021a5f10]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:02 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 1G" returned: 0 in 0.469s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:02 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:02 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:02 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 Jul 31 07:33:02 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:02 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.350s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:02 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 is being set with open permissions: ugo+rw Jul 31 07:33:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:03 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" returned: 0 in 0.442s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:03 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:03 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:03 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2 Jul 31 07:33:03 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:03 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.249s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:03 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" returned: 0 in 0.328s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:03 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.info Jul 31 07:33:03 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2" released by "delete_volume" :: held 0.847s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Created reservations ['65ead147-766a-450c-9a96-7306019f26f2', 'c23228bb-a523-45c8-9991-9d1565294876', '03369480-d305-4fc1-a2fd-240469277bf6', 'a81e3a0a-3b46-4ed9-8abd-d30f859edb65'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:03 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:03 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Acquiring lock "cinder-2843a14c-bcb4-4821-b1d8-811f5e99406b-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-2843a14c-bcb4-4821-b1d8-811f5e99406b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:03 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.info" returned: 0 in 0.426s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Acquiring lock "cinder-quobyte-2843a14c-bcb4-4821-b1d8-811f5e99406b" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:03 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.info is being set with open permissions: ugo+rw Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-2843a14c-bcb4-4821-b1d8-811f5e99406b" acquired by "delete_volume" :: waited 0.040s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:03 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.info Jul 31 07:33:03 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde699b6-4c64-45ae-bb58-cf37ad3c8a12]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:03 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.363s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Deleted volume successfully. Jul 31 07:33:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-75ca38bd-4a07-424e-9bdf-f80ceb973531 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-dde9c9c7-4c93-4baf-9293-a9da0ead3fb2-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:04 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b Jul 31 07:33:04 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:04 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.info" returned: 0 in 0.297s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e902d8ff-ce20-49fc-b654-837b56505fd5 tempest-SnapshotsActionsTest-1890532004 None] Create snapshot completed successfully Jul 31 07:33:04 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b" returned: 0 in 0.458s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:04 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b Jul 31 07:33:04 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:04 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2843a14c-bcb4-4821-b1d8-811f5e99406b" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-quobyte-2843a14c-bcb4-4821-b1d8-811f5e99406b" released by "delete_volume" :: held 0.790s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Created reservations ['a0b33374-1bdc-43ae-b8cc-bc1c6faf2b26', '19b8ab9a-0df6-4b80-b499-879993c44b35', 'f4ebef2d-b614-4d27-a268-a25f5470767f', '860f0720-b06b-4570-8f46-1560415ed990'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:05 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:05 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:05 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.286s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Deleted volume successfully. Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1754a2f1-dc01-40ad-a2b0-e984e0bd7a18 tempest-CinderUnicodeTest-368144032 None] Lock "cinder-2843a14c-bcb4-4821-b1d8-811f5e99406b-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Creating offline snapshot da73c750-8e93-43b8-b0b4-99eb1a7531dd of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9394d631-b26a-4d4f-8d1a-44a45e6f0591]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:06 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:06 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:06 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.583s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:06 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd 1G Jul 31 07:33:06 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:07 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd 1G" returned: 0 in 0.782s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:07 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd Jul 31 07:33:07 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:07 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd" returned: 0 in 0.393s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:07 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd is being set with open permissions: ugo+rw Jul 31 07:33:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:07 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd Jul 31 07:33:07 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:08 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd" returned: 0 in 0.307s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a47ed01f-a8fc-4eb7-830d-956136e8ebc9 tempest-SnapshotsActionsTest-1890532004 None] Create snapshot completed successfully Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-da73c750-8e93-43b8-b0b4-99eb1a7531dd-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-da73c750-8e93-43b8-b0b4-99eb1a7531dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-da73c750-8e93-43b8-b0b4-99eb1a7531dd" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-da73c750-8e93-43b8-b0b4-99eb1a7531dd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Deleting offline snapshot da73c750-8e93-43b8-b0b4-99eb1a7531dd of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] snapshot_file for this snap is: volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee6da4-c78d-437f-88c5-955e9fad308b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:09 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd Jul 31 07:33:09 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:09 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd" returned: 0 in 0.573s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[628a29d7-7cfa-4ea0-b092-40b14265a603]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:10 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:10 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:10 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.471s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:10 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd Jul 31 07:33:10 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:10 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd" returned: 0 in 0.449s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:10 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd Jul 31 07:33:10 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:11 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.da73c750-8e93-43b8-b0b4-99eb1a7531dd" returned: 0 in 0.272s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-da73c750-8e93-43b8-b0b4-99eb1a7531dd" released by "_delete_snapshot" :: held 1.910s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" released by "delete_snapshot" :: held 1.941s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Created reservations ['3c3a4752-ff3f-40b4-9b08-4730aa5f9aa4', '8d520e41-9f99-4784-b500-276e48f2b44f', '2a5bfc5e-d946-48ea-a078-35e95f44d48b', '72e9efe3-3ba8-4a23-9841-09fc5077645c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Delete snapshot completed successfully. Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ce1df1fd-820b-4912-8c84-fcbdeeba07c8 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-da73c750-8e93-43b8-b0b4-99eb1a7531dd-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Creating offline snapshot 5fca6bfa-d557-48d3-879f-17a85006982f of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3abd139-6b2d-4e86-a811-fb69e6db2bda]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:11 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:11 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (5e9c3473-4662-4120-9da1-d0668979aa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50d606c-46a8-4885-8b60-dafb84609085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50d606c-46a8-4885-8b60-dafb84609085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085840213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:12Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7ac045-1f80-4391-b089-d6facdbd6ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7ac045-1f80-4391-b089-d6facdbd6ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6813ae93-e877-489f-bc72-4bf368973018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6813ae93-e877-489f-bc72-4bf368973018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd', 'volume_name': 'volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9f70d9-68cb-46c0-bfec-2424bcee5c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9f70d9-68cb-46c0-bfec-2424bcee5c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d0cef0-8128-4bcb-8bbf-0cc00b9046ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:12 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Volume 6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd', 'volume_size': 1} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:12 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.429s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:12 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f 1G Jul 31 07:33:12 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:12 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f 1G" returned: 0 in 0.413s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:12 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f Jul 31 07:33:12 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:12 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f" returned: 0 in 0.279s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:12 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f is being set with open permissions: ugo+rw Jul 31 07:33:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:13 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f Jul 31 07:33:13 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:13 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f" returned: 0 in 0.261s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.520s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085840213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:12Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Creating volume 6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:33:13 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:13 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd 1073741824 Jul 31 07:33:13 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-92568a53-b4d7-4407-a8b4-fd9906e72fad tempest-SnapshotsActionsTest-1890532004 None] Create snapshot completed successfully Jul 31 07:33:13 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd 1073741824" returned: 0 in 0.458s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:13 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd Jul 31 07:33:13 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-5fca6bfa-d557-48d3-879f-17a85006982f-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-5fca6bfa-d557-48d3-879f-17a85006982f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-5fca6bfa-d557-48d3-879f-17a85006982f" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-5fca6bfa-d557-48d3-879f-17a85006982f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Deleting offline snapshot 5fca6bfa-d557-48d3-879f-17a85006982f of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] snapshot_file for this snap is: volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52eeee8-0076-426e-9872-382fe6a46317]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:14 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd" returned: 0 in 0.316s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d0cef0-8128-4bcb-8bbf-0cc00b9046ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc234f6-39e7-40eb-9053-d3b6c5c6e74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Volume volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd (6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd): created successfully Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc234f6-39e7-40eb-9053-d3b6c5c6e74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (5e9c3473-4662-4120-9da1-d0668979aa2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-190bc143-ad57-4dfc-a63c-ab491b028d00 tempest-ProjectReaderTests-697812413 None] Created volume successfully. Jul 31 07:33:14 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f Jul 31 07:33:14 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:14 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f" returned: 0 in 0.401s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[19311818-50ee-4b3a-884b-48870e3a8e31]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:14 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:14 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:14 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.361s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:14 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f Jul 31 07:33:14 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:15 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f" returned: 0 in 0.374s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:15 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f Jul 31 07:33:15 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Lock "cinder-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-quobyte-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac35fa8-ddeb-4b33-a309-edd39825107f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:15 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.5fca6bfa-d557-48d3-879f-17a85006982f" returned: 0 in 0.274s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-5fca6bfa-d557-48d3-879f-17a85006982f" released by "_delete_snapshot" :: held 1.548s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" released by "delete_snapshot" :: held 1.578s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:15 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd Jul 31 07:33:15 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Created reservations ['6bd5e2ef-8603-4bb5-80e9-5696946d67e2', '56f38999-bf41-4e0c-b285-33a96db1fdb2', 'c09e019e-ceed-461a-b0f2-ab0323327595', '91981d45-ff6c-4d99-8a5a-0be11bb42563'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Delete snapshot completed successfully. Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7a0ec2f9-c78b-49df-806a-25b86fd45e1b tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-5fca6bfa-d557-48d3-879f-17a85006982f-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:15 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd" returned: 0 in 0.395s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:15 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd Jul 31 07:33:15 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:16 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd" returned: 0 in 0.446s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd" released by "delete_volume" :: held 0.893s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Created reservations ['04f8a340-09f1-4957-82dd-e222411bd222', '356e69a9-5974-48e0-a6e4-95d0c2051b10', 'f0a7a7a9-a6ce-4951-944e-fa13c413432d', '21e3c47c-2166-4bcf-8e4c-dcc81ef65853'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:16 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:16 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Creating offline snapshot f2bd568b-7091-4eee-9e26-c99c56242cd1 of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3136bbf3-df3d-436d-a468-43e8f87a5b57]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:16 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:16 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:16 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Deleted volume successfully. Jul 31 07:33:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa6536f4-e6f3-4618-b972-f8020da21c2b tempest-ProjectReaderTests-697812413 None] Lock "cinder-6d374fd8-59e7-4fb2-8e6c-a7081ceb1abd-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:17 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.407s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:17 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 1G Jul 31 07:33:17 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:17 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 1G" returned: 0 in 0.560s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:17 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 Jul 31 07:33:17 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:18 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1" returned: 0 in 0.377s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:18 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 is being set with open permissions: ugo+rw Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:18 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 Jul 31 07:33:18 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (acc4f086-44e0-42e5-b2d2-288bf6668562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4bef0a-3180-4f21-94e0-acac25aad2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4bef0a-3180-4f21-94e0-acac25aad2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50772743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e04e3a1-5f9e-4e94-99fa-6c29dd51331f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:18Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabd4c2-0c4c-4c39-b679-16791c737cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabd4c2-0c4c-4c39-b679-16791c737cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd61ba7-b69c-4cc2-8e3d-bc282823cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd61ba7-b69c-4cc2-8e3d-bc282823cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e04e3a1-5f9e-4e94-99fa-6c29dd51331f', 'volume_name': 'volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5f24d2-7d93-4d59-8e1a-3413d3a867db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5f24d2-7d93-4d59-8e1a-3413d3a867db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b26eae5-884e-413e-bda7-f49ed15dd65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Volume 6e04e3a1-5f9e-4e94-99fa-6c29dd51331f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f', 'volume_size': 1} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:18 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.751s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50772743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e04e3a1-5f9e-4e94-99fa-6c29dd51331f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:18Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Creating volume 6e04e3a1-5f9e-4e94-99fa-6c29dd51331f {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:33:18 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:18 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f 1073741824 Jul 31 07:33:18 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-821e7f84-19b8-4b23-a767-25f6baf26854 tempest-SnapshotsActionsTest-1890532004 None] Create snapshot completed successfully Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-f2bd568b-7091-4eee-9e26-c99c56242cd1-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-f2bd568b-7091-4eee-9e26-c99c56242cd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-f2bd568b-7091-4eee-9e26-c99c56242cd1" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-f2bd568b-7091-4eee-9e26-c99c56242cd1" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Deleting offline snapshot f2bd568b-7091-4eee-9e26-c99c56242cd1 of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] snapshot_file for this snap is: volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b5dbf-33b6-49c7-96b5-1c5578583cd4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:19 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f 1073741824" returned: 0 in 0.637s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:19 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f Jul 31 07:33:19 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:19 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 Jul 31 07:33:19 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:19 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b26eae5-884e-413e-bda7-f49ed15dd65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f95ab0-389f-404d-9833-98aea34f753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Volume volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f (6e04e3a1-5f9e-4e94-99fa-6c29dd51331f): created successfully Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f95ab0-389f-404d-9833-98aea34f753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (acc4f086-44e0-42e5-b2d2-288bf6668562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-69ac0760-8eaf-4936-add5-fc225715d43b tempest-ProjectReaderTests-697812413 None] Created volume successfully. Jul 31 07:33:19 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1" returned: 0 in 0.441s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff3027-c9a3-4641-9994-efae38f7c8c5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:19 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:19 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:19 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.410s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:19 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 Jul 31 07:33:19 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Lock "cinder-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-quobyte-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:20 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1" returned: 0 in 0.507s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f" acquired by "delete_volume" :: waited 0.037s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:20 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1 Jul 31 07:33:20 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aee449-1f03-4c37-8f7e-f22522b2c427]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:20 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f Jul 31 07:33:20 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:20 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.f2bd568b-7091-4eee-9e26-c99c56242cd1" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-f2bd568b-7091-4eee-9e26-c99c56242cd1" released by "_delete_snapshot" :: held 1.737s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" released by "delete_snapshot" :: held 1.780s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Created reservations ['a710417d-0a80-49fa-bf42-5a2b14bb948b', 'd0116791-e5d0-4be6-aa18-b7d315e6bd40', 'ff694ed4-dbfa-4cbd-948b-8675dbdd6178', 'a30cff49-70d7-47d6-96e9-d54a646bdc3b'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:20 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Delete snapshot completed successfully. Jul 31 07:33:20 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f" returned: 0 in 0.439s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9ea7daae-02a5-4b2f-9135-da67d96623fb tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-f2bd568b-7091-4eee-9e26-c99c56242cd1-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:21 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f Jul 31 07:33:21 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:21 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f" returned: 0 in 0.316s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f" released by "delete_volume" :: held 0.813s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Created reservations ['f4ad55c2-0bd5-4f20-8566-edacae40454b', 'b9025efa-2154-4f95-8b58-f5423172f7c8', '4763d44c-01f2-48e1-b825-7a2c027ac759', '9a6efc47-29bc-4c7b-8939-7b192a0df26a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:21 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:21 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Creating offline snapshot fcc9322b-ac90-4e85-ac30-26ddcddf9b0c of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc5a138-61df-4eed-905b-50646dcb8d35]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:21 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:21 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:21 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.451s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Deleted volume successfully. Jul 31 07:33:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5e1292ba-9ecf-4118-a87c-986bb2362fe9 tempest-ProjectReaderTests-697812413 None] Lock "cinder-6e04e3a1-5f9e-4e94-99fa-6c29dd51331f-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:22 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.587s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:33:22 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c 1G Jul 31 07:33:22 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (2b023aae-9094-4095-ae88-f46519bfa85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd4c893-64ca-4965-a353-734defd270f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd4c893-64ca-4965-a353-734defd270f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1949651632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f432a334-1b63-4081-a6d8-7862bf03e178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:22Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000657e8-17cf-451b-b5b2-e704c7275962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000657e8-17cf-451b-b5b2-e704c7275962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be3cf2f-f237-4f9b-b795-f1b8f3817e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be3cf2f-f237-4f9b-b795-f1b8f3817e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f432a334-1b63-4081-a6d8-7862bf03e178', 'volume_name': 'volume-f432a334-1b63-4081-a6d8-7862bf03e178', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411cf9bf-0ffe-476a-9a9f-78b42d2c431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411cf9bf-0ffe-476a-9a9f-78b42d2c431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a83f3c-f30a-426b-857d-b071e3b1cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:22 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Volume f432a334-1b63-4081-a6d8-7862bf03e178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f432a334-1b63-4081-a6d8-7862bf03e178', 'volume_size': 1} Jul 31 07:33:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:23 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c 1G" returned: 0 in 0.789s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:23 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c Jul 31 07:33:23 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:23 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" returned: 0 in 0.538s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:23 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c is being set with open permissions: ugo+rw Jul 31 07:33:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:23 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c Jul 31 07:33:23 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:23 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" returned: 0 in 0.322s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.561s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1949651632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f432a334-1b63-4081-a6d8-7862bf03e178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:22Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Creating volume f432a334-1b63-4081-a6d8-7862bf03e178 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:33:24 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:24 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 1073741824 Jul 31 07:33:24 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-13ce02f7-4f61-45af-a86d-6a8d173508c8 tempest-SnapshotsActionsTest-1890532004 None] Create snapshot completed successfully Jul 31 07:33:24 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 1073741824" returned: 0 in 0.565s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:24 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 Jul 31 07:33:24 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-fcc9322b-ac90-4e85-ac30-26ddcddf9b0c-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-fcc9322b-ac90-4e85-ac30-26ddcddf9b0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Acquiring lock "cinder-quobyte-fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:25 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Deleting offline snapshot fcc9322b-ac90-4e85-ac30-26ddcddf9b0c of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] snapshot_file for this snap is: volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178" returned: 0 in 0.449s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c5e564-07d9-4e5f-9766-5f1a85f5add1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a83f3c-f30a-426b-857d-b071e3b1cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f432a334-1b63-4081-a6d8-7862bf03e178', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555f35e3-9d93-4b06-b494-593f8f4ffa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:25 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Volume volume-f432a334-1b63-4081-a6d8-7862bf03e178 (f432a334-1b63-4081-a6d8-7862bf03e178): created successfully Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555f35e3-9d93-4b06-b494-593f8f4ffa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (2b023aae-9094-4095-ae88-f46519bfa85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-078ec0bb-aa62-4cef-ad63-ff2f033c8e41 tempest-TestShelveInstance-340392848 None] Terminate volume connection completed successfully. Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-078ec0bb-aa62-4cef-ad63-ff2f033c8e41 tempest-TestShelveInstance-340392848 None] Deleting attachment b0b44214-303c-43a7-872d-234cb01e0923. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:33:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-15549c8d-68f9-40a0-8335-792fea389a07 tempest-ProjectReaderTests-697812413 None] Created volume successfully. Jul 31 07:33:25 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c Jul 31 07:33:25 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Acquiring lock "cinder-2ee05502-293b-43db-8ca2-2a10196edd32-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Lock "cinder-2ee05502-293b-43db-8ca2-2a10196edd32-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-f432a334-1b63-4081-a6d8-7862bf03e178-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Lock "cinder-f432a334-1b63-4081-a6d8-7862bf03e178-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Acquiring lock "cinder-quobyte-2ee05502-293b-43db-8ca2-2a10196edd32" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Lock "cinder-quobyte-2ee05502-293b-43db-8ca2-2a10196edd32" acquired by "delete_volume" :: waited 0.039s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:25 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" returned: 0 in 0.531s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23c47a2-90dd-464b-b669-3335a776fd4e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0211a233-d422-4598-b1d4-88ca4de66a02]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-quobyte-f432a334-1b63-4081-a6d8-7862bf03e178" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-f432a334-1b63-4081-a6d8-7862bf03e178" acquired by "delete_volume" :: waited 0.046s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:25 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 Jul 31 07:33:25 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3811af8-9d14-486c-93fc-43190f6ebdbd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:25 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:25 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:26 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 Jul 31 07:33:26 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:26 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32" returned: 0 in 0.458s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:26 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32 Jul 31 07:33:26 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:26 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.624s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:26 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c Jul 31 07:33:26 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:26 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178" returned: 0 in 0.585s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:26 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178 Jul 31 07:33:26 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:26 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2ee05502-293b-43db-8ca2-2a10196edd32" returned: 0 in 0.378s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Lock "cinder-quobyte-2ee05502-293b-43db-8ca2-2a10196edd32" released by "delete_volume" :: held 0.940s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG cinder.quota [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Created reservations ['56276e40-8f25-454d-81fc-4c2649e92f49', '8f0e406c-c445-4281-857b-c88dde0a9951', '002c7f27-2974-4f66-b54b-61beeba2fedc', 'c9f0370e-27c2-467c-9433-0b815cb0d8ab'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:26 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f432a334-1b63-4081-a6d8-7862bf03e178" returned: 0 in 0.450s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:26 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:26 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-f432a334-1b63-4081-a6d8-7862bf03e178" released by "delete_volume" :: held 1.119s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Created reservations ['88a1ca33-c661-4945-bc2e-efb2201d5894', 'f5773e6d-26e4-41b0-92a9-c9880574573c', 'c472a85c-93fb-4850-b553-82921aacefd9', '60a55980-8036-4ff2-b5af-2b84b7f52130'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:26 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" returned: 0 in 0.682s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:27 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c Jul 31 07:33:27 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:27 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:27 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:27 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.403s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.manager [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Deleted volume successfully. Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [req-5a58bc18-9a6c-4f6f-89aa-092707916c62 req-93f3be2a-eabd-445d-9251-d874346f88c4 tempest-TestShelveInstance-340392848 None] Lock "cinder-2ee05502-293b-43db-8ca2-2a10196edd32-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:27 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" returned: 0 in 0.382s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:27 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.319s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-fcc9322b-ac90-4e85-ac30-26ddcddf9b0c" released by "_delete_snapshot" :: held 2.364s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Deleted volume successfully. Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" released by "delete_snapshot" :: held 2.405s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c94b2c35-d0d4-442b-be7c-5f9238e036b1 tempest-ProjectReaderTests-697812413 None] Lock "cinder-f432a334-1b63-4081-a6d8-7862bf03e178-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Created reservations ['82200b82-efb4-4432-98d3-9a70d8e1f440', '95ac8e9b-3ea0-4de8-b12a-5f12da8d9822', '03a5dd0b-7b08-48c5-af7d-4839137aa17e', 'c21ca20d-138b-497c-8bd4-bd7869dedf90'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Delete snapshot completed successfully. Jul 31 07:33:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c742fc8a-acec-46a5-a3e9-a2802e034a31 tempest-SnapshotsActionsTest-2009763549 None] Lock "cinder-fcc9322b-ac90-4e85-ac30-26ddcddf9b0c-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (cc826bdb-39a7-4582-a027-e523b3fab3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541720c3-6f30-42c9-a670-a8c8168640cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541720c3-6f30-42c9-a670-a8c8168640cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195244662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94df6a07-8649-49fb-bb26-3c7f72504da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:28Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f736af8-8a43-47d6-ae07-27c2aaaec3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f736af8-8a43-47d6-ae07-27c2aaaec3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228130fd-a9c7-4832-8249-989391748b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228130fd-a9c7-4832-8249-989391748b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94df6a07-8649-49fb-bb26-3c7f72504da5', 'volume_name': 'volume-94df6a07-8649-49fb-bb26-3c7f72504da5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6e3a2b-70f1-43b2-9471-095be7af2702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6e3a2b-70f1-43b2-9471-095be7af2702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68254376-6d7d-47fe-9b92-283ba233785f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:28 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Volume 94df6a07-8649-49fb-bb26-3c7f72504da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94df6a07-8649-49fb-bb26-3c7f72504da5', 'volume_size': 1} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195244662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94df6a07-8649-49fb-bb26-3c7f72504da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd749b1640c14f7aa1e34023408ac310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:28Z,use_quota=True,user_id='43169487f41148bf92800037df8b77da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Creating volume 94df6a07-8649-49fb-bb26-3c7f72504da5 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:33:28 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:28 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 1073741824 Jul 31 07:33:28 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "cinder-7ef06821-765b-4c1d-838a-4cde8aff9891-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-7ef06821-765b-4c1d-838a-4cde8aff9891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "cinder-quobyte-7ef06821-765b-4c1d-838a-4cde8aff9891" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-quobyte-7ef06821-765b-4c1d-838a-4cde8aff9891" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Deleting offline snapshot 7ef06821-765b-4c1d-838a-4cde8aff9891 of volume 759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] snapshot_file for this snap is: volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[732c79e4-bc25-400c-aa7c-e15bc0f278c9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:29 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:29 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 1073741824" returned: 0 in 0.815s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:29 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:29 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 Jul 31 07:33:29 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:29 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5" returned: 0 in 0.305s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:29 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68254376-6d7d-47fe-9b92-283ba233785f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94df6a07-8649-49fb-bb26-3c7f72504da5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea05f1d-d658-4844-8116-26398e9c0b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.563s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759c3af4-773b-4e72-8299-bcbcbf143957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:33:29 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Volume volume-94df6a07-8649-49fb-bb26-3c7f72504da5 (94df6a07-8649-49fb-bb26-3c7f72504da5): created successfully Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea05f1d-d658-4844-8116-26398e9c0b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Flow 'volume_create_manager' (cc826bdb-39a7-4582-a027-e523b3fab3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e5e1f8-ba5a-482e-942d-f2fcd0f00173]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6291691b-920a-47ca-9d44-afd2c1cdb43b tempest-ProjectReaderTests-697812413 None] Created volume successfully. Jul 31 07:33:29 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 Jul 31 07:33:29 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:30 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957" returned: 0 in 0.465s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:30 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:30 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-94df6a07-8649-49fb-bb26-3c7f72504da5-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Lock "cinder-94df6a07-8649-49fb-bb26-3c7f72504da5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Acquiring lock "cinder-quobyte-94df6a07-8649-49fb-bb26-3c7f72504da5" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-94df6a07-8649-49fb-bb26-3c7f72504da5" acquired by "delete_volume" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf42f874-5e6b-4420-b6fe-67d449149d80]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:30 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.657s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:30 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 Jul 31 07:33:30 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:30 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891 Jul 31 07:33:30 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:31 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5" returned: 0 in 0.469s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:31 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5 Jul 31 07:33:31 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:31 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957.7ef06821-765b-4c1d-838a-4cde8aff9891" returned: 0 in 0.459s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-quobyte-7ef06821-765b-4c1d-838a-4cde8aff9891" released by "_delete_snapshot" :: held 2.386s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" released by "delete_snapshot" :: held 2.453s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Created reservations ['06f84a63-1aa1-4ca6-be4b-8888f7f8bbd4', '9aa79c3b-0b2c-43a6-92a3-9216fc5b7099', '60a8c8ea-3b14-4961-bdfd-992d0b599a23', 'c939426e-3d22-445f-b202-d31ec0ca1760'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:31 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-94df6a07-8649-49fb-bb26-3c7f72504da5" returned: 0 in 0.396s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Lock "cinder-quobyte-94df6a07-8649-49fb-bb26-3c7f72504da5" released by "delete_volume" :: held 0.979s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:31 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Delete snapshot completed successfully. Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-d56c4820-a016-4d2b-bc8d-7e44a87b83cb tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-7ef06821-765b-4c1d-838a-4cde8aff9891-delete_snapshot" released by "delete_snapshot" :: held 2.807s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Created reservations ['9b8c65ff-74f4-4094-a58e-d597e30fc4a7', '67ff2ed1-c0d5-46e4-86fc-d855534ea60b', '05642f6b-016d-448c-aafe-90582edf0524', '00ca7c96-b515-4fd1-a966-2febcdd50b79'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:32 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:32 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "cinder-759c3af4-773b-4e72-8299-bcbcbf143957-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:32 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-759c3af4-773b-4e72-8299-bcbcbf143957-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.419s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:32 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Deleted volume successfully. Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-647e6a1a-37dd-499f-8a04-c76725c99054 tempest-ProjectReaderTests-697812413 None] Lock "cinder-94df6a07-8649-49fb-bb26-3c7f72504da5-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0887dbd-d4e0-4c5c-9185-6b3cdccc2ff0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:32 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 Jul 31 07:33:32 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:32 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957" returned: 0 in 0.432s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:33 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957 Jul 31 07:33:33 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:33 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-759c3af4-773b-4e72-8299-bcbcbf143957" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-quobyte-759c3af4-773b-4e72-8299-bcbcbf143957" released by "delete_volume" :: held 0.871s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Created reservations ['90445245-bea4-44fa-8049-52f745afbb19', '99c99344-edf9-47cd-856d-0820ef266bf3', 'e1c61c74-46df-44ca-a760-c58e6adb3bcf', '9f2ab554-25ba-41d9-9dd2-ec3d27eaa918'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:33 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:33 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:33 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:33 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:33 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Deleted volume successfully. Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51ade587-31bc-47b8-aad9-665582aabf1b tempest-SnapshotsActionsTest-1890532004 None] Lock "cinder-759c3af4-773b-4e72-8299-bcbcbf143957-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:34 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.456s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:33:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:33:43 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=183,cinder:INSERT=65,cinder:UPDATE=219,cinder:DELETE=15 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:33:44 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:INSERT=52,cinder:UPDATE=232,cinder:SELECT=182,cinder:DELETE=15 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Flow 'volume_create_manager' (f7be89c9-2ce3-4244-8199-d40910200454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6128bcef-aa0f-437e-9f7a-5ac38f8db5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6128bcef-aa0f-437e-9f7a-5ac38f8db5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-551073790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c38947d35b432baa821a0d77181472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:54Z,use_quota=True,user_id='9b95167d7a1340e89e6ba880b4c3c850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58df804e-1706-488a-90b7-610d7ac7e6a6),volume_type_id=58df804e-1706-488a-90b7-610d7ac7e6a6)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b56c83-4277-4ccd-abe6-586742af6cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b56c83-4277-4ccd-abe6-586742af6cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7af7be-54fe-495b-b5f0-cccc21983fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7af7be-54fe-495b-b5f0-cccc21983fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c', 'volume_name': 'volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b7a15-5c5e-4312-97e0-3cc1a2be8bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b7a15-5c5e-4312-97e0-3cc1a2be8bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63917695-e9ce-40e3-8b18-dab90e3a5c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:54 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Volume 352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c', 'volume_size': 1} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-551073790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c38947d35b432baa821a0d77181472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:33:54Z,use_quota=True,user_id='9b95167d7a1340e89e6ba880b4c3c850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58df804e-1706-488a-90b7-610d7ac7e6a6),volume_type_id=58df804e-1706-488a-90b7-610d7ac7e6a6)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Creating volume 352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:33:54 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:54 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c 1073741824 Jul 31 07:33:54 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:54 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c 1073741824" returned: 0 in 0.502s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:54 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c Jul 31 07:33:54 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:55 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:33:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63917695-e9ce-40e3-8b18-dab90e3a5c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc88640-f731-4012-a24e-48c5a92958fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:33:55 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Volume volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c (352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c): created successfully Jul 31 07:33:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc88640-f731-4012-a24e-48c5a92958fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:33:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Flow 'volume_create_manager' (f7be89c9-2ce3-4244-8199-d40910200454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:33:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-295dc135-992d-48c1-a45b-38a74029c130 tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Created volume successfully. Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:56 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:56 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:56 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.324s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:56 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fd1a5367-ea8b-428c-8675-2cd911b543fa tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Retype volume completed successfully. Jul 31 07:33:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Acquiring lock "cinder-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "cinder-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Acquiring lock "cinder-quobyte-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "cinder-quobyte-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392e3ab-2d96-42b4-b526-c4746999d498]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:58 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c Jul 31 07:33:58 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:58 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c" returned: 0 in 0.380s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:58 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c Jul 31 07:33:58 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:58 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "cinder-quobyte-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c" released by "delete_volume" :: held 0.716s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:33:58 devstack cinder-volume[88915]: WARNING cinder.quota [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:33:58 devstack cinder-volume[88915]: WARNING cinder.quota [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Created reservations ['4a0a41fd-fae8-4158-affa-9a6fffabdf01', '4b56ae1d-5683-4d88-95f2-75e570f5bada', '12bec778-6e97-4267-b325-1f31ac5ec510', 'efb82d09-f2db-4dcd-808c-43ff67c297f4'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:33:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:33:58 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:33:58 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:33:59 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 31 07:33:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.323s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:33:59 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:33:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Deleted volume successfully. Jul 31 07:33:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8e3ff8e6-c5ee-40a8-959e-52ae8dbf563e tempest-VolumeRetypeWithoutMigrationTest-422632022 None] Lock "cinder-352c6bf3-7a9a-47fd-bb9d-da3b90b9dc3c-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Flow 'volume_create_manager' (85756179-7c1c-400f-a55f-ec967bffb071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6c0a6f-2132-4b97-bb80-37c883ebfa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6c0a6f-2132-4b97-bb80-37c883ebfa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2097774979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bba0dc0-4c8d-4d80-b0c8-dae0492f4841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b48c68767749eeb5299e9de6ded3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:03Z,use_quota=True,user_id='04d02ee447394e63aef04fca9996eb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baaee0f-433b-41dc-910e-5d17af0e3992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baaee0f-433b-41dc-910e-5d17af0e3992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24289a2-b264-4779-97f0-91b99b772d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24289a2-b264-4779-97f0-91b99b772d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bba0dc0-4c8d-4d80-b0c8-dae0492f4841', 'volume_name': 'volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9c99fd-03c9-4751-8a20-f2d54603b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9c99fd-03c9-4751-8a20-f2d54603b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293d77bd-fdba-4739-bff3-0ba0fc27a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:03 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Volume 2bba0dc0-4c8d-4d80-b0c8-dae0492f4841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841', 'volume_size': 1} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2097774979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bba0dc0-4c8d-4d80-b0c8-dae0492f4841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b48c68767749eeb5299e9de6ded3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:03Z,use_quota=True,user_id='04d02ee447394e63aef04fca9996eb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Creating volume 2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:03 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:03 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 1073741824 Jul 31 07:34:03 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:04 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 1073741824" returned: 0 in 0.509s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:04 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 Jul 31 07:34:04 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:04 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" returned: 0 in 0.295s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293d77bd-fdba-4739-bff3-0ba0fc27a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce17fc69-54cc-442b-b9cb-53327fb7cb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:04 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Volume volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 (2bba0dc0-4c8d-4d80-b0c8-dae0492f4841): created successfully Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce17fc69-54cc-442b-b9cb-53327fb7cb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Flow 'volume_create_manager' (85756179-7c1c-400f-a55f-ec967bffb071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-bc9ab09c-04a4-4a54-9545-5140c7a415a3 tempest-TestStampPattern-1715021088 None] Created volume successfully. Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Flow 'volume_create_manager' (ba602db5-19af-463b-862f-9a1e16a67871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f42f3e-a0c5-4665-9d77-f99e201cf96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f42f3e-a0c5-4665-9d77-f99e201cf96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1899772154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cbb126a5aa40ffacb15f3afb8329e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:05Z,use_quota=True,user_id='55fb2b3030644728aca93fdd24947a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4a0e19-b366-42bc-99b7-41e28ebff08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4a0e19-b366-42bc-99b7-41e28ebff08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dac483-a769-46ba-ab77-bdecf73e393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dac483-a769-46ba-ab77-bdecf73e393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8', 'volume_name': 'volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e97d271-bd05-4b10-806c-9f5dedc6be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e97d271-bd05-4b10-806c-9f5dedc6be2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d960aa86-a0da-4130-8922-d09242f4ff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Volume ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8', 'volume_size': 1} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1899772154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cbb126a5aa40ffacb15f3afb8329e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:05Z,use_quota=True,user_id='55fb2b3030644728aca93fdd24947a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Creating volume ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:05 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:05 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 1073741824 Jul 31 07:34:05 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:06 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 1073741824" returned: 0 in 0.609s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:06 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 Jul 31 07:34:06 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:06 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8" returned: 0 in 0.282s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d960aa86-a0da-4130-8922-d09242f4ff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f979204-230a-4a4e-a2b8-843e8ba671c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:06 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Volume volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 (ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8): created successfully Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f979204-230a-4a4e-a2b8-843e8ba671c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Flow 'volume_create_manager' (ba602db5-19af-463b-862f-9a1e16a67871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-18737c47-e114-40e5-a29e-99245c3c53b4 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Created volume successfully. Jul 31 07:34:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-53f9f969-384d-46ef-90da-ef2d57a60aa5 req-6bb730e7-98f9-4a6c-88c1-ad0171450508 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-53f9f969-384d-46ef-90da-ef2d57a60aa5 req-6bb730e7-98f9-4a6c-88c1-ad0171450508 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-53f9f969-384d-46ef-90da-ef2d57a60aa5 req-6bb730e7-98f9-4a6c-88c1-ad0171450508 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-53f9f969-384d-46ef-90da-ef2d57a60aa5 req-6bb730e7-98f9-4a6c-88c1-ad0171450508 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd1572cb-78fb-49de-b538-ff2fc0f8e431', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:34:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-53f9f969-384d-46ef-90da-ef2d57a60aa5 req-6bb730e7-98f9-4a6c-88c1-ad0171450508 tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] attachment_update completed successfully. Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Flow 'volume_create_manager' (705b7e26-c948-4792-8fce-0ec6155edf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892f1a47-ce34-4aec-a5d4-fad1f89dfe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892f1a47-ce34-4aec-a5d4-fad1f89dfe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2129252935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238f1dc8-ef98-43ce-bf20-eaa0db496254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c507d215b02424aa0d636f9d360dd51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:09Z,use_quota=True,user_id='05417567476e47e885bcf3904e458565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7437db06-b08c-4159-8ff1-076d0dd964c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7437db06-b08c-4159-8ff1-076d0dd964c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f57c978-b946-4834-bac8-3623dcceddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f57c978-b946-4834-bac8-3623dcceddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238f1dc8-ef98-43ce-bf20-eaa0db496254', 'volume_name': 'volume-238f1dc8-ef98-43ce-bf20-eaa0db496254', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020d2ccc-d66b-4ea5-a97f-f4399c389d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020d2ccc-d66b-4ea5-a97f-f4399c389d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d99ac4d-5a5b-46ff-bed4-be7cf4bfa2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Volume 238f1dc8-ef98-43ce-bf20-eaa0db496254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238f1dc8-ef98-43ce-bf20-eaa0db496254', 'volume_size': 1} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2129252935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238f1dc8-ef98-43ce-bf20-eaa0db496254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c507d215b02424aa0d636f9d360dd51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:09Z,use_quota=True,user_id='05417567476e47e885bcf3904e458565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Creating volume 238f1dc8-ef98-43ce-bf20-eaa0db496254 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:09 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:09 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 1073741824 Jul 31 07:34:09 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:10 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 1073741824" returned: 0 in 0.848s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:10 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 Jul 31 07:34:10 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:10 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254" returned: 0 in 0.339s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d99ac4d-5a5b-46ff-bed4-be7cf4bfa2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238f1dc8-ef98-43ce-bf20-eaa0db496254', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b118ef-62ce-4b50-82c3-045b9a1e8938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Volume volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 (238f1dc8-ef98-43ce-bf20-eaa0db496254): created successfully Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b118ef-62ce-4b50-82c3-045b9a1e8938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Flow 'volume_create_manager' (705b7e26-c948-4792-8fce-0ec6155edf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a9c644bd-6f43-4faf-a52a-ecc489bccb68 tempest-VolumesTransfersTest-1779567830 None] Created volume successfully. Jul 31 07:34:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8975b993-4621-4850-8501-06ac92ea88f2 tempest-VolumesTransfersTest-1850253178 None] Transfer volume completed successfully. Jul 31 07:34:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-b0576875-558f-4b40-abf3-aed550163012 req-f8410146-d559-4a71-8985-f36fed2044fd tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Terminate volume connection completed successfully. Jul 31 07:34:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-b0576875-558f-4b40-abf3-aed550163012 req-f8410146-d559-4a71-8985-f36fed2044fd tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Deleting attachment dd1572cb-78fb-49de-b538-ff2fc0f8e431. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:34:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Acquiring lock "cinder-238f1dc8-ef98-43ce-bf20-eaa0db496254-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Lock "cinder-238f1dc8-ef98-43ce-bf20-eaa0db496254-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Acquiring lock "cinder-quobyte-238f1dc8-ef98-43ce-bf20-eaa0db496254" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Lock "cinder-quobyte-238f1dc8-ef98-43ce-bf20-eaa0db496254" acquired by "delete_volume" :: waited 0.043s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa0f937-424a-4c8c-94d8-576f164b1b4a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:13 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 Jul 31 07:34:13 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Acquiring lock "cinder-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:13 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "cinder-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254" returned: 0 in 0.531s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:13 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254 Jul 31 07:34:13 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Acquiring lock "cinder-quobyte-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "cinder-quobyte-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd3378b-3c43-469e-956f-0de32f1e1e7f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:13 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 Jul 31 07:34:13 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:13 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-238f1dc8-ef98-43ce-bf20-eaa0db496254" returned: 0 in 0.365s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Lock "cinder-quobyte-238f1dc8-ef98-43ce-bf20-eaa0db496254" released by "delete_volume" :: held 0.968s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Created reservations ['90b874d7-9fe6-4fb3-83ed-4631255215e0', '571a12fb-93a2-47db-a9a5-676e66dae3e8', '325056b3-2c6f-4d15-b887-39dce396e22b', '93b96f03-b5bb-4b86-8089-aa7e86e56908'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:14 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8" returned: 0 in 0.505s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:14 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:14 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:14 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8 Jul 31 07:34:14 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:14 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Deleted volume successfully. Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-953bfd99-3ae5-439d-a3d8-04859aca3465 tempest-VolumesTransfersTest-791587324 None] Lock "cinder-238f1dc8-ef98-43ce-bf20-eaa0db496254-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:14 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8" returned: 0 in 0.362s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "cinder-quobyte-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8" released by "delete_volume" :: held 0.912s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Created reservations ['1087f197-6347-4fe8-8161-e1d6a64ee505', '68455005-5ee0-480f-9d50-6bf38c1e07e3', '48bfc1d9-0f17-4343-b190-6eb10eb44df1', '6b1ab614-c641-47e1-b170-eb4f44da3b42'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:14 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:14 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:14 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.283s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:14 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Deleted volume successfully. Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca985e3a-70c4-4133-937b-4d69eedc70aa tempest-TestServerVolumeAttachScenarioOldVersion-1059973649 None] Lock "cinder-ed30dfa5-2157-4fbd-b4cb-1b33b631c9e8-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Flow 'volume_create_manager' (2f285c54-7f64-45e8-acee-0767fe1c1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ea8526-ec8f-419b-b061-d69e8e8774fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ea8526-ec8f-419b-b061-d69e8e8774fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1060716564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049eee5b-4e09-4186-a9a9-93de0c5fe9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c507d215b02424aa0d636f9d360dd51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:16Z,use_quota=True,user_id='05417567476e47e885bcf3904e458565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d8a108-f483-4925-843d-e90efa13ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d8a108-f483-4925-843d-e90efa13ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39136b6d-e7a7-4ce1-943f-870b865e18c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39136b6d-e7a7-4ce1-943f-870b865e18c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049eee5b-4e09-4186-a9a9-93de0c5fe9b3', 'volume_name': 'volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a145d73f-609a-4d3a-b890-45515848b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a145d73f-609a-4d3a-b890-45515848b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec417291-fb2a-4e83-9fe3-0cd20cb423fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Volume 049eee5b-4e09-4186-a9a9-93de0c5fe9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3', 'volume_size': 1} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1060716564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049eee5b-4e09-4186-a9a9-93de0c5fe9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c507d215b02424aa0d636f9d360dd51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:16Z,use_quota=True,user_id='05417567476e47e885bcf3904e458565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Creating volume 049eee5b-4e09-4186-a9a9-93de0c5fe9b3 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:15 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:15 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 1073741824 Jul 31 07:34:15 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:16 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 1073741824" returned: 0 in 0.856s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:16 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 Jul 31 07:34:16 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:17 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3" returned: 0 in 0.337s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec417291-fb2a-4e83-9fe3-0cd20cb423fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37eb4550-369e-4063-91d0-5b2c730d0d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:17 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Volume volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 (049eee5b-4e09-4186-a9a9-93de0c5fe9b3): created successfully Jul 31 07:34:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37eb4550-369e-4063-91d0-5b2c730d0d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Flow 'volume_create_manager' (2f285c54-7f64-45e8-acee-0767fe1c1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2a07e128-4abd-4407-b450-d4a8cc1961ba tempest-VolumesTransfersTest-1779567830 None] Created volume successfully. Jul 31 07:34:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Acquiring lock "cinder-049eee5b-4e09-4186-a9a9-93de0c5fe9b3-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Lock "cinder-049eee5b-4e09-4186-a9a9-93de0c5fe9b3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Acquiring lock "cinder-quobyte-049eee5b-4e09-4186-a9a9-93de0c5fe9b3" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Lock "cinder-quobyte-049eee5b-4e09-4186-a9a9-93de0c5fe9b3" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:18 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3a124e-f5ae-4146-9d94-beb6ebdd89fd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:18 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 Jul 31 07:34:18 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:19 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3" returned: 0 in 0.551s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:19 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3 Jul 31 07:34:19 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:19 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-049eee5b-4e09-4186-a9a9-93de0c5fe9b3" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Lock "cinder-quobyte-049eee5b-4e09-4186-a9a9-93de0c5fe9b3" released by "delete_volume" :: held 0.895s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Created reservations ['799960f9-9777-42d3-ae65-aa530534c305', '27f36285-87b5-49c6-8e28-9596f00be47c', '01a72e1d-b2ff-4c71-b3a7-422f1b916aef', '7423f0a8-716b-42a1-9c5a-c9ce8c5e6650'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:19 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:19 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:19 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.276s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Deleted volume successfully. Jul 31 07:34:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-35ad90bc-0635-4fe0-a285-95b5af3b9caf tempest-VolumesTransfersTest-791587324 None] Lock "cinder-049eee5b-4e09-4186-a9a9-93de0c5fe9b3-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (63c89e0a-ffe9-499b-bbf0-2c8692eabc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c53297-979e-48cd-8ced-786affb99a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c53297-979e-48cd-8ced-786affb99a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2129403343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ca2f69-986b-4abf-ace7-ae8f1cef0f26,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:26Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c669278-85d4-4927-9d5b-7e77ecc039b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c669278-85d4-4927-9d5b-7e77ecc039b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d373aa-9f4e-4d98-ba1e-e9536cd4b400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d373aa-9f4e-4d98-ba1e-e9536cd4b400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ca2f69-986b-4abf-ace7-ae8f1cef0f26', 'volume_name': 'volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b132a50-4fb3-456b-86c0-66fea1c101d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b132a50-4fb3-456b-86c0-66fea1c101d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dffbee7-4f4e-48a1-a548-f1585b59e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:25 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Volume 50ca2f69-986b-4abf-ace7-ae8f1cef0f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26', 'volume_size': 1} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2129403343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ca2f69-986b-4abf-ace7-ae8f1cef0f26,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:26Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Creating volume 50ca2f69-986b-4abf-ace7-ae8f1cef0f26 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:25 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:25 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 1073741824 Jul 31 07:34:25 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:26 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 1073741824" returned: 0 in 0.439s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:26 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 Jul 31 07:34:26 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:26 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dffbee7-4f4e-48a1-a548-f1585b59e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f848167b-c96b-4ec8-a450-e07d1f35e07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:26 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Volume volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 (50ca2f69-986b-4abf-ace7-ae8f1cef0f26): created successfully Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f848167b-c96b-4ec8-a450-e07d1f35e07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (63c89e0a-ffe9-499b-bbf0-2c8692eabc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:26 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7de85c35-4e00-4781-963a-8136d4c5b055 tempest-VolumesGetTest-240944134 None] Created volume successfully. Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (52d3c41b-202a-4798-8d96-68e4f2a1d16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85c3502-c5a6-4bea-8665-9d4385be43e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85c3502-c5a6-4bea-8665-9d4385be43e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-863167161',display_name='tempest-VolumesGetTest-Volume-609698818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716d2590-5ec0-4094-8b60-60901eb23fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:29Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286c1e0f-ddbc-4467-a1e0-17351c9e98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286c1e0f-ddbc-4467-a1e0-17351c9e98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e02965-f039-46d2-a019-24fa56aff36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e02965-f039-46d2-a019-24fa56aff36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716d2590-5ec0-4094-8b60-60901eb23fb9', 'volume_name': 'volume-716d2590-5ec0-4094-8b60-60901eb23fb9', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52313b20-46f8-4832-84c0-31491c2d1985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52313b20-46f8-4832-84c0-31491c2d1985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229e94c-bbba-46d8-ad3b-56e93e60cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:28 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Volume 716d2590-5ec0-4094-8b60-60901eb23fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716d2590-5ec0-4094-8b60-60901eb23fb9', 'volume_size': 1} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-863167161',display_name='tempest-VolumesGetTest-Volume-609698818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716d2590-5ec0-4094-8b60-60901eb23fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:29Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Creating volume 716d2590-5ec0-4094-8b60-60901eb23fb9 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:28 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:28 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 1073741824 Jul 31 07:34:28 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:29 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 1073741824" returned: 0 in 0.522s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:29 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 Jul 31 07:34:29 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:29 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9" returned: 0 in 0.304s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229e94c-bbba-46d8-ad3b-56e93e60cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716d2590-5ec0-4094-8b60-60901eb23fb9', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390a287c-ff2c-4d36-939a-1351d107820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:29 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Volume volume-716d2590-5ec0-4094-8b60-60901eb23fb9 (716d2590-5ec0-4094-8b60-60901eb23fb9): created successfully Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390a287c-ff2c-4d36-939a-1351d107820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (52d3c41b-202a-4798-8d96-68e4f2a1d16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6a8a43fd-7bb0-4a38-944d-6dca6f8b99d9 tempest-VolumesGetTest-240944134 None] Created volume successfully. Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-716d2590-5ec0-4094-8b60-60901eb23fb9-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Lock "cinder-716d2590-5ec0-4094-8b60-60901eb23fb9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-716d2590-5ec0-4094-8b60-60901eb23fb9" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-716d2590-5ec0-4094-8b60-60901eb23fb9" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73a8b7d-e564-4448-abc5-eb0247fafee0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:31 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 Jul 31 07:34:31 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:31 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9" returned: 0 in 0.458s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:31 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9 Jul 31 07:34:31 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:31 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-716d2590-5ec0-4094-8b60-60901eb23fb9" returned: 0 in 0.283s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-716d2590-5ec0-4094-8b60-60901eb23fb9" released by "delete_volume" :: held 0.796s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Created reservations ['7466a351-312f-43bf-80f1-981b21b80e75', '7d5eba13-0853-447e-bef5-bf9cb281ad1e', '9646f844-c46d-4ca6-a0e1-eadc5f26c92c', '42374fe0-ea6e-4873-9e6b-8fb746e014fe'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:32 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:32 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-50ca2f69-986b-4abf-ace7-ae8f1cef0f26-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Lock "cinder-50ca2f69-986b-4abf-ace7-ae8f1cef0f26-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:32 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:32 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Deleted volume successfully. Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-50ca2f69-986b-4abf-ace7-ae8f1cef0f26" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-81819cf3-ebcc-4256-a2e5-172b8ad5f33c tempest-VolumesGetTest-240944134 None] Lock "cinder-716d2590-5ec0-4094-8b60-60901eb23fb9-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-50ca2f69-986b-4abf-ace7-ae8f1cef0f26" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[676f2e19-3070-4758-b1e2-9c23c9c45912]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:32 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 Jul 31 07:34:32 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:32 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26" returned: 0 in 0.429s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:33 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26 Jul 31 07:34:33 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:33 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-50ca2f69-986b-4abf-ace7-ae8f1cef0f26" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-50ca2f69-986b-4abf-ace7-ae8f1cef0f26" released by "delete_volume" :: held 0.748s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Created reservations ['6cfb24d1-4324-4f1f-8ffc-b3b9cc6ec72e', '2dc77d5b-5d1f-4238-845d-64e74e79b525', 'de019504-635c-4754-bec7-413483c90a65', '865dfa89-bb06-4829-b973-1796eb12afde'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:33 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:33 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:33 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.279s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Deleted volume successfully. Jul 31 07:34:33 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:33 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-33e4c1f5-0eb5-4a24-bf4e-e38e8a39c7f4 tempest-VolumesGetTest-240944134 None] Lock "cinder-50ca2f69-986b-4abf-ace7-ae8f1cef0f26-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:34 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.360s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (9551a4b1-95b6-4ee1-8c7e-c2dafc36ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eb6c85-bf0e-4735-bbd1-a8cb38b7c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eb6c85-bf0e-4735-bbd1-a8cb38b7c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304455513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c1958d-bdf8-4565-a332-7968aea8d938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:34Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e187eb-4f87-4924-9551-611d93cf3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e187eb-4f87-4924-9551-611d93cf3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ffc3fa-8ce2-4eb8-acdb-d8da12655ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ffc3fa-8ce2-4eb8-acdb-d8da12655ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c1958d-bdf8-4565-a332-7968aea8d938', 'volume_name': 'volume-07c1958d-bdf8-4565-a332-7968aea8d938', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647463cb-b82a-4b0f-9536-4e3b77744054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647463cb-b82a-4b0f-9536-4e3b77744054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e314819-8522-4a0e-898c-ee037c74074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:34 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Volume 07c1958d-bdf8-4565-a332-7968aea8d938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c1958d-bdf8-4565-a332-7968aea8d938', 'volume_size': 1} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304455513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c1958d-bdf8-4565-a332-7968aea8d938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:34Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Creating volume 07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:34 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:34 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 1073741824 Jul 31 07:34:34 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:34 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 1073741824" returned: 0 in 0.455s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:34 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 Jul 31 07:34:34 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:35 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e314819-8522-4a0e-898c-ee037c74074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c1958d-bdf8-4565-a332-7968aea8d938', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc71713e-ac0e-4f4c-8e91-f33c971c54d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:35 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Volume volume-07c1958d-bdf8-4565-a332-7968aea8d938 (07c1958d-bdf8-4565-a332-7968aea8d938): created successfully Jul 31 07:34:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc71713e-ac0e-4f4c-8e91-f33c971c54d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (9551a4b1-95b6-4ee1-8c7e-c2dafc36ef47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-53216b2b-5177-476a-b125-99354496f4fb tempest-VolumesGetTest-240944134 None] Created volume successfully. Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (7c7d6351-20ab-4f0e-bb32-d6a2df10ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae8c6a0-83e4-480d-93ec-54a319f706ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae8c6a0-83e4-480d-93ec-54a319f706ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1110929593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ad6ec0-1e3a-45c7-8069-9bb75517941f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=07c1958d-bdf8-4565-a332-7968aea8d938,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:37Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf8bee8-5a86-4f93-a864-05dc2a139417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf8bee8-5a86-4f93-a864-05dc2a139417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c3f36e-505f-4061-893a-8f22f10ca630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c3f36e-505f-4061-893a-8f22f10ca630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '34ad6ec0-1e3a-45c7-8069-9bb75517941f', 'volume_name': 'volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f', 'volume_size': 1, 'source_volid': '07c1958d-bdf8-4565-a332-7968aea8d938', 'source_volstatus': 'available'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55060e0-4ca7-40fa-bfbe-342248ee11ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55060e0-4ca7-40fa-bfbe-342248ee11ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86447346-2878-45de-828c-f36cf03a8a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:37 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Volume 34ad6ec0-1e3a-45c7-8069-9bb75517941f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f', 'volume_size': 1, 'source_volid': '07c1958d-bdf8-4565-a332-7968aea8d938', 'source_volstatus': 'available'} Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:37 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Cloning volume 07c1958d-bdf8-4565-a332-7968aea8d938 to volume 34ad6ec0-1e3a-45c7-8069-9bb75517941f Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Creating offline snapshot 217574ad-e507-4748-adb8-e327d6ecfa5b of volume 07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fa55d3-8f7e-4e02-b960-0a98de9945d3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:37 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 Jul 31 07:34:37 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-a538b6b5-caa1-4c2a-9a17-f802e7920833 req-67e06928-663e-42df-8d64-141bf9030028 tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:37 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938" returned: 0 in 0.466s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:37 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b 1G Jul 31 07:34:37 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:38 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b 1G" returned: 0 in 0.480s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c1958d-bdf8-4565-a332-7968aea8d938 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:38 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c1958d-bdf8-4565-a332-7968aea8d938 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b Jul 31 07:34:38 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:38 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c1958d-bdf8-4565-a332-7968aea8d938 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b" returned: 0 in 0.337s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:38 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b is being set with open permissions: ugo+rw Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:38 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b Jul 31 07:34:38 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:38 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b" returned: 0 in 0.259s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:38 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.info Jul 31 07:34:38 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:38 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.info" returned: 0 in 0.334s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:38 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.info is being set with open permissions: ugo+rw Jul 31 07:34:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:39 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.info Jul 31 07:34:39 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:39 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.info" returned: 0 in 0.307s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-34ad6ec0-1e3a-45c7-8069-9bb75517941f" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-34ad6ec0-1e3a-45c7-8069-9bb75517941f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] snapshot: 217574ad-e507-4748-adb8-e327d6ecfa5b, volume: 34ad6ec0-1e3a-45c7-8069-9bb75517941f, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a3daa-ab19-4ce7-b380-aa988b592d7a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:39 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b Jul 31 07:34:39 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:39 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b" returned: 0 in 0.427s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07c1958d-bdf8-4565-a332-7968aea8d938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f172ade5-aab1-409f-8a3f-8705dbc72d9a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:40 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 Jul 31 07:34:40 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:40 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938" returned: 0 in 0.431s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:40 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:34:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:40 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f Jul 31 07:34:40 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:45 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f" returned: 0 in 5.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:45 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab8fffb-83c5-481b-9b35-14e7fbe09caa]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:45 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 Jul 31 07:34:45 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:46 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938" returned: 0 in 0.597s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:34:46 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Converted 1024.00 MB image at 190.53 MB/s Jul 31 07:34:46 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f is being set with open permissions: ugo+rw Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:46 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f Jul 31 07:34:46 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:46 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-34ad6ec0-1e3a-45c7-8069-9bb75517941f" released by "_copy_volume_from_snapshot" :: held 7.226s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-217574ad-e507-4748-adb8-e327d6ecfa5b" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-217574ad-e507-4748-adb8-e327d6ecfa5b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Deleting offline snapshot 217574ad-e507-4748-adb8-e327d6ecfa5b of volume 07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] snapshot_file for this snap is: volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7f2e2-2742-4298-95ce-01110b2f0c36]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:46 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b Jul 31 07:34:46 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:47 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b" returned: 0 in 0.399s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07c1958d-bdf8-4565-a332-7968aea8d938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b9f6c-d330-42d2-a755-c8ff6b301913]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:47 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 Jul 31 07:34:47 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:47 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:47 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b Jul 31 07:34:47 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:47 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b" returned: 0 in 0.399s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:47 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b Jul 31 07:34:47 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:48 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938.217574ad-e507-4748-adb8-e327d6ecfa5b" returned: 0 in 0.260s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-217574ad-e507-4748-adb8-e327d6ecfa5b" released by "_delete_snapshot" :: held 1.527s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.152s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-a538b6b5-caa1-4c2a-9a17-f802e7920833 req-67e06928-663e-42df-8d64-141bf9030028 tempest-TestStampPattern-1715021088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.776s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-a538b6b5-caa1-4c2a-9a17-f802e7920833 req-67e06928-663e-42df-8d64-141bf9030028 tempest-TestStampPattern-1715021088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86447346-2878-45de-828c-f36cf03a8a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f', 'volume_size': 1, 'source_volid': '07c1958d-bdf8-4565-a332-7968aea8d938', 'source_volstatus': 'available'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ebb047-6a52-4871-9923-b56c3144301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:48 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Volume volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f (34ad6ec0-1e3a-45c7-8069-9bb75517941f): created successfully Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ebb047-6a52-4871-9923-b56c3144301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (7c7d6351-20ab-4f0e-bb32-d6a2df10ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-a538b6b5-caa1-4c2a-9a17-f802e7920833 req-67e06928-663e-42df-8d64-141bf9030028 tempest-TestStampPattern-1715021088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b5fd619-fe1b-4642-9fef-626d4e03ade4', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:34:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ed4ffb61-1f55-4ff5-b74d-b13184f49c6d tempest-VolumesGetTest-240944134 None] Created volume successfully. Jul 31 07:34:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-a538b6b5-caa1-4c2a-9a17-f802e7920833 req-67e06928-663e-42df-8d64-141bf9030028 tempest-TestStampPattern-1715021088 None] attachment_update completed successfully. Jul 31 07:34:49 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (e94df5d7-d254-4d29-ba25-c062f4ffc1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdfa69c-9339-4419-924c-726cc4a67932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdfa69c-9339-4419-924c-726cc4a67932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-904899116',display_name='tempest-VolumesGetTest-Volume-581473128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c213da-53fb-470a-9076-36ed76c3a92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:50Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c63651-640d-4f6c-b645-e651d1c32057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c63651-640d-4f6c-b645-e651d1c32057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e5d5ac-39d5-4be1-b95a-ea139d9e4dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e5d5ac-39d5-4be1-b95a-ea139d9e4dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c213da-53fb-470a-9076-36ed76c3a92b', 'volume_name': 'volume-34c213da-53fb-470a-9076-36ed76c3a92b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5d7278-4718-4305-ad4d-5f21e8f502f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5d7278-4718-4305-ad4d-5f21e8f502f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4492711-0af3-43e7-85a8-adeef9da3b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Volume 34c213da-53fb-470a-9076-36ed76c3a92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c213da-53fb-470a-9076-36ed76c3a92b', 'volume_size': 1} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-904899116',display_name='tempest-VolumesGetTest-Volume-581473128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c213da-53fb-470a-9076-36ed76c3a92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:50Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Creating volume 34c213da-53fb-470a-9076-36ed76c3a92b {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:50 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:50 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b 1073741824 Jul 31 07:34:50 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:50 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b 1073741824" returned: 0 in 0.519s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:50 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b Jul 31 07:34:50 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:50 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4492711-0af3-43e7-85a8-adeef9da3b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c213da-53fb-470a-9076-36ed76c3a92b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6f22e4-929e-4185-a7d9-ae5f102710ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Volume volume-34c213da-53fb-470a-9076-36ed76c3a92b (34c213da-53fb-470a-9076-36ed76c3a92b): created successfully Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6f22e4-929e-4185-a7d9-ae5f102710ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (e94df5d7-d254-4d29-ba25-c062f4ffc1de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5ec943e3-722c-4aa5-9930-aaa9dea064b5 tempest-VolumesGetTest-240944134 None] Created volume successfully. Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-34c213da-53fb-470a-9076-36ed76c3a92b-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Lock "cinder-34c213da-53fb-470a-9076-36ed76c3a92b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-34c213da-53fb-470a-9076-36ed76c3a92b" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-34c213da-53fb-470a-9076-36ed76c3a92b" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc31984-7584-466c-961d-736274afbfc4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:52 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b Jul 31 07:34:52 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:52 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:52 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b Jul 31 07:34:52 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:52 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34c213da-53fb-470a-9076-36ed76c3a92b" returned: 0 in 0.332s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-34c213da-53fb-470a-9076-36ed76c3a92b" released by "delete_volume" :: held 0.832s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Created reservations ['9e02444d-f954-4065-9483-706f8dace56b', '60f36a62-e174-447d-865a-00c718fb8612', '870df973-63e5-4057-a2b2-a713219e5359', '3ab4a140-8aa0-44f0-ab2f-fd2944112775'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:53 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:53 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-34ad6ec0-1e3a-45c7-8069-9bb75517941f-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Lock "cinder-34ad6ec0-1e3a-45c7-8069-9bb75517941f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-34ad6ec0-1e3a-45c7-8069-9bb75517941f" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:53 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.304s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-34ad6ec0-1e3a-45c7-8069-9bb75517941f" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Deleted volume successfully. Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[73beddd7-1435-4d49-9315-2b25e9c6a93b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aad212f5-93a3-4a25-b8fa-f5d530b723a6 tempest-VolumesGetTest-240944134 None] Lock "cinder-34c213da-53fb-470a-9076-36ed76c3a92b-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-55c700d9-e9ad-4985-b5b0-13a099a4dc94 req-b8b5f827-d4e1-4b2f-9323-45bc9f0cd1b5 tempest-TestStampPattern-1715021088 None] Terminate volume connection completed successfully. Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-55c700d9-e9ad-4985-b5b0-13a099a4dc94 req-b8b5f827-d4e1-4b2f-9323-45bc9f0cd1b5 tempest-TestStampPattern-1715021088 None] Deleting attachment 6b5fd619-fe1b-4642-9fef-626d4e03ade4. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:34:53 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f Jul 31 07:34:53 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:53 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f" returned: 0 in 0.451s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:53 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f Jul 31 07:34:53 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:54 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-34ad6ec0-1e3a-45c7-8069-9bb75517941f" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-34ad6ec0-1e3a-45c7-8069-9bb75517941f" released by "delete_volume" :: held 0.798s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=102,cinder:SELECT=69,cinder:INSERT=21,cinder:DELETE=11 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=96,cinder:UPDATE=89,cinder:INSERT=19,cinder:DELETE=6 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Created reservations ['f5a1ee2a-63f2-40ac-912f-c23644df70cd', 'c8e6f01d-a408-4935-9ef0-63d5b1946908', '9d6d9ef5-8fe0-4c07-af62-2ecaf4fd9085', '1861984f-6e18-4265-a363-2ee50ab98297'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Creating offline snapshot e6dc29ba-a0d0-44e7-afb6-683f1fe30369 of volume 2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f251598f-a3a4-4f07-a3e7-d84228b02ea2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:54 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:54 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:54 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 Jul 31 07:34:54 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-07c1958d-bdf8-4565-a332-7968aea8d938-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Lock "cinder-07c1958d-bdf8-4565-a332-7968aea8d938-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-07c1958d-bdf8-4565-a332-7968aea8d938" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-07c1958d-bdf8-4565-a332-7968aea8d938" acquired by "delete_volume" :: waited 0.039s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:34:54 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.396s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Deleted volume successfully. Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f22b03-be2a-48d5-a13d-235c8192ed6f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f18da715-efcb-470c-a08c-f79dfb1b6eda tempest-VolumesGetTest-240944134 None] Lock "cinder-34ad6ec0-1e3a-45c7-8069-9bb75517941f-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:54 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" returned: 0 in 0.500s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:54 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 1G Jul 31 07:34:54 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:54 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 Jul 31 07:34:54 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:55 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938" returned: 0 in 0.409s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:55 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938 Jul 31 07:34:55 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:55 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 1G" returned: 0 in 0.488s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:55 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 Jul 31 07:34:55 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:55 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-07c1958d-bdf8-4565-a332-7968aea8d938" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-07c1958d-bdf8-4565-a332-7968aea8d938" released by "delete_volume" :: held 0.761s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Created reservations ['37cef164-01be-4689-bcf2-36cda0a984c7', 'b54d85ae-b7ba-499d-8646-3317e7002007', '29da36ad-7516-46bd-90f4-eaaa1c0ec405', 'e58d67fb-e860-46f2-8ed6-c90c8fece177'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:55 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369" returned: 0 in 0.330s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:55 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 is being set with open permissions: ugo+rw Jul 31 07:34:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:55 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:34:55 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:55 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 Jul 31 07:34:55 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:56 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.461s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:56 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369" returned: 0 in 0.460s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Deleted volume successfully. Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f65e0cde-99bd-43f3-b92d-343d0d52f892 tempest-VolumesGetTest-240944134 None] Lock "cinder-07c1958d-bdf8-4565-a332-7968aea8d938-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:56 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.info Jul 31 07:34:56 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:56 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.info" returned: 0 in 0.306s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:56 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.info is being set with open permissions: ugo+rw Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:56 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.info Jul 31 07:34:56 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:56 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.info" returned: 0 in 0.284s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (71ae93b3-431d-4e1a-9d63-af214134f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5090de2-1a8d-4cd5-9b2d-ec44007c5453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5090de2-1a8d-4cd5-9b2d-ec44007c5453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-66759603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354de154-b0a5-4486-be47-c007ea4e8be9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:57Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83a6c33-b002-4ca7-ab48-3787b8502729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83a6c33-b002-4ca7-ab48-3787b8502729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2c3c43-3d9f-4126-8d8c-1799c15224ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:56 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:34:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-130bed0b-16d5-4068-8d3a-217bdb830f9f tempest-TestStampPattern-1715021088 None] Create snapshot completed successfully Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2c3c43-3d9f-4126-8d8c-1799c15224ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '354de154-b0a5-4486-be47-c007ea4e8be9', 'volume_name': 'volume-354de154-b0a5-4486-be47-c007ea4e8be9', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e4d144-3d72-48a3-a726-6680aae3e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e4d144-3d72-48a3-a726-6680aae3e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b40ede-80f8-4385-83d3-3e0c5c7fe0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:57 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Volume 354de154-b0a5-4486-be47-c007ea4e8be9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-354de154-b0a5-4486-be47-c007ea4e8be9', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Trying to clone 354de154-b0a5-4486-be47-c007ea4e8be9 from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Flow 'volume_create_manager' (62485c58-e0f5-4bf8-8de8-dd423682562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361ad52f-d400-46c3-92cc-45f5dadc7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361ad52f-d400-46c3-92cc-45f5dadc7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-476239720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b2dd6b5c734ef491741c1deab5eec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:58Z,use_quota=True,user_id='5efd32cc12444b558ccdebbb56bab9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b92213-ee3e-4102-a1ea-bc500a8daae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b92213-ee3e-4102-a1ea-bc500a8daae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc0d6b4-5a0f-426f-b14a-46d370dba73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc0d6b4-5a0f-426f-b14a-46d370dba73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644', 'volume_name': 'volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5418430d-e042-4aa9-ba3b-a8c75906beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5418430d-e042-4aa9-ba3b-a8c75906beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9121f5-464e-44bd-9b35-0af3465a7e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:57 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Volume 65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644', 'volume_size': 1} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-476239720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b2dd6b5c734ef491741c1deab5eec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:58Z,use_quota=True,user_id='5efd32cc12444b558ccdebbb56bab9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Creating volume 65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:57 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:57 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 1073741824 Jul 31 07:34:57 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:34:57 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Image download 20.69 MB at 20.69 MB/s Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c444b92-dac4-4d10-bfc9-20b857587574]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:57 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD Jul 31 07:34:57 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:58 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 1073741824" returned: 0 in 0.502s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:58 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e is fetched for user b610e19e683e481b84a4ec7550ac79f8. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:58 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 Jul 31 07:34:58 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[73345ac9-06f5-46d0-ada9-8679144a7989]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:58 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD Jul 31 07:34:58 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:58 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" returned: 0 in 0.316s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9121f5-464e-44bd-9b35-0af3465a7e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2beeae-2f6c-4136-bf4a-1831434dfd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:34:58 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Volume volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 (65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644): created successfully Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2beeae-2f6c-4136-bf4a-1831434dfd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Flow 'volume_create_manager' (62485c58-e0f5-4bf8-8de8-dd423682562a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:34:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0b84e0fc-7295-4bc1-bf30-c9172075eb0a tempest-TestImageHashVerification-1739189902 None] Created volume successfully. Jul 31 07:34:58 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-66759603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354de154-b0a5-4486-be47-c007ea4e8be9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:34:57Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Creating volume 354de154-b0a5-4486-be47-c007ea4e8be9 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:34:58 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:34:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:58 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 1073741824 Jul 31 07:34:58 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:59 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 1073741824" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:59 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 Jul 31 07:34:59 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:59 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9" returned: 0 in 0.254s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Attempting download of 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume 354de154-b0a5-4486-be47-c007ea4e8be9. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6a7b9e-add9-4042-8e7f-251637e808d0]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_tdscn0xo {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:34:59 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_tdscn0xo Jul 31 07:34:59 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:34:59 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_tdscn0xo" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:34:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_tdscn0xo {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:00 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_tdscn0xo Jul 31 07:35:00 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:00 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_tdscn0xo" returned: 1 in 0.363s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_tdscn0xo' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea9d16-94f9-449a-b12e-81006c50a4b0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:00 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD Jul 31 07:35:00 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7553a8a0-0e65-4c41-92be-ab0adcb0a49b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:00 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] 0c598684-d1fc-49c0-b0cf-3a02a6f8533e was qcow2, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:00 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 Jul 31 07:35:00 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:00 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 Jul 31 07:35:00 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:00 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" returned: 0 in 0.413s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f883e2-9ff3-43f3-946b-86ba87c1a32c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:01 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 Jul 31 07:35:01 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:01 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" returned: 0 in 0.423s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 /opt/stack/data/cinder/conversion/65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644.temp_image.512ce166-762a-4f85-a5a7-c04a19297c97rtlm3uor.img {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:01 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 /opt/stack/data/cinder/conversion/65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644.temp_image.512ce166-762a-4f85-a5a7-c04a19297c97rtlm3uor.img Jul 31 07:35:01 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:03 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9" returned: 0 in 2.731s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:03 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c598684-d1fc-49c0-b0cf-3a02a6f8533e_qt_3ta4sdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:35:03 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Converted 112.00 MB image at 40.93 MB/s Jul 31 07:35:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:03 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 1G Jul 31 07:35:03 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:04 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 1G" returned: 0 in 0.861s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Downloaded image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e ((None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}])) to volume 354de154-b0a5-4486-be47-c007ea4e8be9 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Temporary image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e for user b610e19e683e481b84a4ec7550ac79f8 is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Marking volume 354de154-b0a5-4486-be47-c007ea4e8be9 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Copying metadata from image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e to 354de154-b0a5-4486-be47-c007ea4e8be9. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Creating volume glance metadata for volume 354de154-b0a5-4486-be47-c007ea4e8be9 backed by image 0c598684-d1fc-49c0-b0cf-3a02a6f8533e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b40ede-80f8-4385-83d3-3e0c5c7fe0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354de154-b0a5-4486-be47-c007ea4e8be9', 'volume_size': 1, 'image_id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09b845a57f95425f9d7e62ad87de1090', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c598684-d1fc-49c0-b0cf-3a02a6f8533e', 'created_at': datetime.datetime(2026, 7, 31, 5, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 16, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c598684-d1fc-49c0-b0cf-3a02a6f8533e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc6cc39-f59f-4ff5-bb1c-4b7536ca9bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:04 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Volume volume-354de154-b0a5-4486-be47-c007ea4e8be9 (354de154-b0a5-4486-be47-c007ea4e8be9): created successfully Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc6cc39-f59f-4ff5-bb1c-4b7536ca9bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (71ae93b3-431d-4e1a-9d63-af214134f66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6036c20c-0f63-4b35-acbf-a4080db0c08a tempest-VolumesGetTest-240944134 None] Created volume successfully. Jul 31 07:35:06 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 /opt/stack/data/cinder/conversion/65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644.temp_image.512ce166-762a-4f85-a5a7-c04a19297c97rtlm3uor.img" returned: 0 in 5.026s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d34df4f-865c-4ed4-8c04-a77a909b0172]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:06 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 Jul 31 07:35:06 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (ee71e981-ef62-4bba-a713-56e62f8bafd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbf025f-2b1a-459a-96ce-3da3695f63ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbf025f-2b1a-459a-96ce-3da3695f63ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:35:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-831708032',display_name='tempest-VolumesGetTest-Volume-1220724849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7390ff-6354-4658-b4b9-b2dd06184ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:35:07Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12794263-1acb-47c0-866d-34616eb796c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12794263-1acb-47c0-866d-34616eb796c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e972cd2-371f-4a1e-8a07-2f9ee6b778ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e972cd2-371f-4a1e-8a07-2f9ee6b778ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7390ff-6354-4658-b4b9-b2dd06184ce4', 'volume_name': 'volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa74b784-1eda-4504-a336-5582048adc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa74b784-1eda-4504-a336-5582048adc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d137b4ec-90b4-4b28-aac4-ec2fd4fb8be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Volume fd7390ff-6354-4658-b4b9-b2dd06184ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4', 'volume_size': 1} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:07 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" returned: 0 in 0.597s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644.temp_image.512ce166-762a-4f85-a5a7-c04a19297c97rtlm3uor.img {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:35:07 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Converted 1024.00 MB image at 203.71 MB/s Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] 512ce166-762a-4f85-a5a7-c04a19297c97 was raw, no need to convert to raw {{(pid=88915) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Flow 'volume_create_manager' (99a69dc3-a62c-498a-afec-79a76ff55375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cbc90e-d4c9-4812-9d76-eb98c2070d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cbc90e-d4c9-4812-9d76-eb98c2070d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1875579956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c7e58a-6c53-4f35-b7dc-f32c4bca44ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b48c68767749eeb5299e9de6ded3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e6dc29ba-a0d0-44e7-afb6-683f1fe30369,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:35:08Z,use_quota=True,user_id='04d02ee447394e63aef04fca9996eb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66a4d86-a7c9-4494-a400-baa9cf5998ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66a4d86-a7c9-4494-a400-baa9cf5998ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0961d912-eb78-42af-9923-fa8748bf686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0961d912-eb78-42af-9923-fa8748bf686e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74c7e58a-6c53-4f35-b7dc-f32c4bca44ce', 'volume_name': 'volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce', 'volume_size': 1, 'snapshot_id': 'e6dc29ba-a0d0-44e7-afb6-683f1fe30369'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625d55de-66c8-4fa5-b803-d2e7f680c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625d55de-66c8-4fa5-b803-d2e7f680c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c24215-5fb0-40cb-aa92-04b92dc28521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:07 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Volume 74c7e58a-6c53-4f35-b7dc-f32c4bca44ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce', 'volume_size': 1, 'snapshot_id': 'e6dc29ba-a0d0-44e7-afb6-683f1fe30369'} Jul 31 07:35:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:17 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:INSERT=10,cinder:SELECT=26,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:35:17 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=28,cinder:INSERT=14,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.263s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Uploaded volume to glance image-id: 512ce166-762a-4f85-a5a7-c04a19297c97. {{(pid=88915) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.772s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:35:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-831708032',display_name='tempest-VolumesGetTest-Volume-1220724849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7390ff-6354-4658-b4b9-b2dd06184ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ead5170eef4638891021bfce0a9011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:35:07Z,use_quota=True,user_id='b610e19e683e481b84a4ec7550ac79f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Creating volume fd7390ff-6354-4658-b4b9-b2dd06184ce4 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:35:28 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:35:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-000def30-85c0-4b08-b6eb-9d281b147857 tempest-TestImageHashVerification-1739189902 None] Copy volume to image completed successfully. Jul 31 07:35:28 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 1073741824 Jul 31 07:35:28 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:29 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 1073741824" returned: 0 in 0.430s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:29 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 Jul 31 07:35:29 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:29 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 21.650s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-quobyte-e6dc29ba-a0d0-44e7-afb6-683f1fe30369-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-e6dc29ba-a0d0-44e7-afb6-683f1fe30369-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Creating volume 74c7e58a-6c53-4f35-b7dc-f32c4bca44ce from snapshot e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-quobyte-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d137b4ec-90b4-4b28-aac4-ec2fd4fb8be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b364a774-b74a-4707-aaf2-2ad340861059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:29 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Volume volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 (fd7390ff-6354-4658-b4b9-b2dd06184ce4): created successfully Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b364a774-b74a-4707-aaf2-2ad340861059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Flow 'volume_create_manager' (ee71e981-ef62-4bba-a713-56e62f8bafd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] snapshot: e6dc29ba-a0d0-44e7-afb6-683f1fe30369, volume: 74c7e58a-6c53-4f35-b7dc-f32c4bca44ce, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3036ddc7-8f55-4ee2-946e-0d72a1e6e650 tempest-VolumesGetTest-240944134 None] Created volume successfully. Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b5bc94-f9f1-40ec-87a5-de18df20a0bc]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:29 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 Jul 31 07:35:29 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Acquiring lock "cinder-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Lock "cinder-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Acquiring lock "cinder-quobyte-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Lock "cinder-quobyte-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e323a-3e72-4aef-8ba6-92607d7f631c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:30 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 Jul 31 07:35:30 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:30 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369" returned: 0 in 0.529s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[43567bd8-0af4-453d-b9da-81c0a02a1707]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:30 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 Jul 31 07:35:30 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:30 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" returned: 0 in 0.411s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:30 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644 Jul 31 07:35:30 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:30 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" returned: 0 in 0.408s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:30 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce Jul 31 07:35:30 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:30 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" returned: 0 in 0.295s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Lock "cinder-quobyte-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644" released by "delete_volume" :: held 0.773s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Created reservations ['7e4e40c4-e23b-4d26-9694-c86afbdc5195', '3efefdc0-82ad-4555-a6d1-9e4955d2b73f', '037f2f6c-8e3c-4c55-87fa-a0800a56bb46', '04876e7b-940d-4da4-9fa4-584559106528'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:35:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-fd7390ff-6354-4658-b4b9-b2dd06184ce4-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Lock "cinder-fd7390ff-6354-4658-b4b9-b2dd06184ce4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:31 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:35:31 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-fd7390ff-6354-4658-b4b9-b2dd06184ce4" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-fd7390ff-6354-4658-b4b9-b2dd06184ce4" acquired by "delete_volume" :: waited 0.024s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae8e35-a5a5-4a5e-9861-e99abc97708c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:31 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 Jul 31 07:35:31 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:31 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.288s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:35:31 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Deleted volume successfully. Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-27ec7315-632d-4868-b497-b77e1afe847a tempest-TestImageHashVerification-1739189902 None] Lock "cinder-65e7d89a-4ba7-432a-a2a4-6ae6bf3b9644-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:31 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4" returned: 0 in 0.702s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:31 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4 Jul 31 07:35:31 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:32 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fd7390ff-6354-4658-b4b9-b2dd06184ce4" returned: 0 in 0.691s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-fd7390ff-6354-4658-b4b9-b2dd06184ce4" released by "delete_volume" :: held 1.469s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Created reservations ['0a2f5e2d-0891-45e5-8ee5-c0a6305261aa', 'ea8471fe-6898-493d-b42f-717452224846', 'd6728737-2ce5-481d-a23a-c1dab173bb5d', '14d786b1-0ec2-4e52-9cd5-70f0960fb617'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:32 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:35:32 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:33 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.508s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:35:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Deleted volume successfully. Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-977f32c2-7a10-4dfb-9677-57f950609ad1 tempest-VolumesGetTest-240944134 None] Lock "cinder-fd7390ff-6354-4658-b4b9-b2dd06184ce4-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-354de154-b0a5-4486-be47-c007ea4e8be9-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Lock "cinder-354de154-b0a5-4486-be47-c007ea4e8be9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Acquiring lock "cinder-quobyte-354de154-b0a5-4486-be47-c007ea4e8be9" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-354de154-b0a5-4486-be47-c007ea4e8be9" acquired by "delete_volume" :: waited 0.036s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[db937855-784f-4065-8da7-a47509e764ba]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:33 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:35:33 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:34 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 Jul 31 07:35:34 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:34 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.824s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:35:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:35:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:35:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:35:35 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9" returned: 0 in 1.262s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:35 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9 Jul 31 07:35:35 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:35 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-354de154-b0a5-4486-be47-c007ea4e8be9" returned: 0 in 0.382s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Lock "cinder-quobyte-354de154-b0a5-4486-be47-c007ea4e8be9" released by "delete_volume" :: held 1.822s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Created reservations ['6d19afcd-a6cc-4c61-b254-94213b100261', '28155b25-f7dc-42b0-981c-6f354aa58c10', '4e5b54b4-eda8-40e4-8241-f1f8d5098d18', 'd3abc228-1d6f-4bd2-a35e-df6235d9ed2d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:36 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:35:36 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:36 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" returned: 0 in 5.790s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:36 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd790948-4b4a-4b56-9c11-7383f1be7896]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:36 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.602s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:36 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:35:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Deleted volume successfully. Jul 31 07:35:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6c947b0c-c32e-46af-8568-4c221b6ccd1f tempest-VolumesGetTest-240944134 None] Lock "cinder-354de154-b0a5-4486-be47-c007ea4e8be9-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:36 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 Jul 31 07:35:36 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:37 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" returned: 0 in 0.704s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:35:37 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Converted 1024.00 MB image at 176.82 MB/s Jul 31 07:35:37 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce is being set with open permissions: ugo+rw Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:37 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce Jul 31 07:35:37 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:37 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" released by "_copy_volume_from_snapshot" :: held 7.847s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-e6dc29ba-a0d0-44e7-afb6-683f1fe30369-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" released by "_create_volume_from_snapshot" :: held 7.928s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.959s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c24215-5fb0-40cb-aa92-04b92dc28521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce', 'volume_size': 1, 'snapshot_id': 'e6dc29ba-a0d0-44e7-afb6-683f1fe30369'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cc2d9a-432d-4d9f-bfb9-05b2078a2d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:37 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Volume volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce (74c7e58a-6c53-4f35-b7dc-f32c4bca44ce): created successfully Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cc2d9a-432d-4d9f-bfb9-05b2078a2d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Flow 'volume_create_manager' (99a69dc3-a62c-498a-afec-79a76ff55375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5f1a0018-8c6d-40e1-9147-6f93be3daf3d tempest-TestStampPattern-1715021088 None] Created volume successfully. Jul 31 07:35:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-4a52a29e-148a-4451-a1dc-298f408ee246 req-f16199db-c8d7-499a-adf0-ba96bd4ce945 tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-4a52a29e-148a-4451-a1dc-298f408ee246 req-f16199db-c8d7-499a-adf0-ba96bd4ce945 tempest-TestStampPattern-1715021088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfc4992-ae11-4ac3-ab0b-be1b90a355ab]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-4a52a29e-148a-4451-a1dc-298f408ee246 req-f16199db-c8d7-499a-adf0-ba96bd4ce945 tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:43 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce Jul 31 07:35:43 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:43 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [req-4a52a29e-148a-4451-a1dc-298f408ee246 req-f16199db-c8d7-499a-adf0-ba96bd4ce945 tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" returned: 0 in 0.441s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-4a52a29e-148a-4451-a1dc-298f408ee246 req-f16199db-c8d7-499a-adf0-ba96bd4ce945 tempest-TestStampPattern-1715021088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.469s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-4a52a29e-148a-4451-a1dc-298f408ee246 req-f16199db-c8d7-499a-adf0-ba96bd4ce945 tempest-TestStampPattern-1715021088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac3753f0-633a-4e0c-aa16-18470b7a7d54', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:35:43 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-4a52a29e-148a-4451-a1dc-298f408ee246 req-f16199db-c8d7-499a-adf0-ba96bd4ce945 tempest-TestStampPattern-1715021088 None] attachment_update completed successfully. Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Flow 'volume_create_manager' (1ba0ff7e-d693-4bce-bc37-2f533fda79a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796cc7c5-156f-4afb-8763-3be80f988fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796cc7c5-156f-4afb-8763-3be80f988fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-368091403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb66032-20e4-4230-aaba-87388c890104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d649241a25842f79a26d71ee062db15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:35:46Z,use_quota=True,user_id='02434399f8234ddfa5d5905e18b80aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3393f4-cd47-47e8-bc80-102bccbfcd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3393f4-cd47-47e8-bc80-102bccbfcd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a71a3e0-0ca1-418e-ab70-06625ce2f9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a71a3e0-0ca1-418e-ab70-06625ce2f9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb66032-20e4-4230-aaba-87388c890104', 'volume_name': 'volume-edb66032-20e4-4230-aaba-87388c890104', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb674c1-c0b4-4022-8953-5aa2742e9b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb674c1-c0b4-4022-8953-5aa2742e9b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64716af7-d975-4e3f-8032-a69746f973b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Volume edb66032-20e4-4230-aaba-87388c890104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb66032-20e4-4230-aaba-87388c890104', 'volume_size': 1} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-368091403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb66032-20e4-4230-aaba-87388c890104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d649241a25842f79a26d71ee062db15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:35:46Z,use_quota=True,user_id='02434399f8234ddfa5d5905e18b80aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Creating volume edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:35:45 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:35:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:45 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 1073741824 Jul 31 07:35:45 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:46 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 1073741824" returned: 0 in 0.618s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:46 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 Jul 31 07:35:46 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:47 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-48243082-4bb6-49b0-9031-9ab36767259b req-ec6274d8-4b4a-4540-b70c-0c8f37fcb176 tempest-TestStampPattern-1715021088 None] Terminate volume connection completed successfully. Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-48243082-4bb6-49b0-9031-9ab36767259b req-ec6274d8-4b4a-4540-b70c-0c8f37fcb176 tempest-TestStampPattern-1715021088 None] Deleting attachment ac3753f0-633a-4e0c-aa16-18470b7a7d54. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104" returned: 0 in 0.388s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64716af7-d975-4e3f-8032-a69746f973b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb66032-20e4-4230-aaba-87388c890104', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a043041c-e21a-451f-b047-00ace5edfeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:47 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Volume volume-edb66032-20e4-4230-aaba-87388c890104 (edb66032-20e4-4230-aaba-87388c890104): created successfully Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a043041c-e21a-451f-b047-00ace5edfeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Flow 'volume_create_manager' (1ba0ff7e-d693-4bce-bc37-2f533fda79a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ce56d15b-65ea-4793-8e95-5f8c154cfb7d tempest-VolumeDependencyTests-287679459 None] Created volume successfully. Jul 31 07:35:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Creating offline snapshot 61692a08-9a22-44b3-92b6-7f030dc0220d of volume edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:35:48 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96ac34-69a7-47c1-8c3b-474ae737cb15]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:48 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 Jul 31 07:35:48 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:48 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104" returned: 0 in 0.504s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:48 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d 1G Jul 31 07:35:48 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:49 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d 1G" returned: 0 in 0.675s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb66032-20e4-4230-aaba-87388c890104 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:49 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb66032-20e4-4230-aaba-87388c890104 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d Jul 31 07:35:49 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:49 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb66032-20e4-4230-aaba-87388c890104 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d" returned: 0 in 0.507s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:49 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d is being set with open permissions: ugo+rw Jul 31 07:35:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:49 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d Jul 31 07:35:49 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:50 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d" returned: 0 in 0.382s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:50 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.info Jul 31 07:35:50 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:50 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.info" returned: 0 in 0.359s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:50 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.info is being set with open permissions: ugo+rw Jul 31 07:35:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:50 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.info Jul 31 07:35:50 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:50 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.info" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.837s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-718655df-8039-47ba-9c3f-c018f334232a tempest-VolumeDependencyTests-287679459 None] Create snapshot completed successfully Jul 31 07:35:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Lock "cinder-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-quobyte-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:51 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2897a841-cdde-4169-ac19-da10b2642a6e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:51 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce Jul 31 07:35:51 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Flow 'volume_create_manager' (84ec47e9-69b0-456b-80b2-ad176662f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e398c75b-82a0-41eb-a00b-ec71e3c7823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e398c75b-82a0-41eb-a00b-ec71e3c7823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1935721709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e505ca78-1294-4203-a95c-193b49487f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d649241a25842f79a26d71ee062db15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61692a08-9a22-44b3-92b6-7f030dc0220d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:35:52Z,use_quota=True,user_id='02434399f8234ddfa5d5905e18b80aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e578b4-2e47-4ae6-b995-d6827595d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e578b4-2e47-4ae6-b995-d6827595d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b06e9-4e75-4d65-8233-8b26c4e4faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b06e9-4e75-4d65-8233-8b26c4e4faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e505ca78-1294-4203-a95c-193b49487f71', 'volume_name': 'volume-e505ca78-1294-4203-a95c-193b49487f71', 'volume_size': 1, 'snapshot_id': '61692a08-9a22-44b3-92b6-7f030dc0220d'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8097ccf7-9023-473e-946f-b7346edf3130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8097ccf7-9023-473e-946f-b7346edf3130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a141621-bfe2-4fc9-b706-5139f30c88c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:52 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Volume e505ca78-1294-4203-a95c-193b49487f71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e505ca78-1294-4203-a95c-193b49487f71', 'volume_size': 1, 'snapshot_id': '61692a08-9a22-44b3-92b6-7f030dc0220d'} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-quobyte-61692a08-9a22-44b3-92b6-7f030dc0220d-e505ca78-1294-4203-a95c-193b49487f71" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-61692a08-9a22-44b3-92b6-7f030dc0220d-e505ca78-1294-4203-a95c-193b49487f71" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Creating volume e505ca78-1294-4203-a95c-193b49487f71 from snapshot 61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-quobyte-e505ca78-1294-4203-a95c-193b49487f71" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-e505ca78-1294-4203-a95c-193b49487f71" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] snapshot: 61692a08-9a22-44b3-92b6-7f030dc0220d, volume: e505ca78-1294-4203-a95c-193b49487f71, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:35:52 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" returned: 0 in 0.522s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[253efd14-2e80-45a5-b989-8634d1b74fa3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:52 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce Jul 31 07:35:52 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:52 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d Jul 31 07:35:52 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:52 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" returned: 0 in 0.317s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce" released by "delete_volume" :: held 0.894s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Created reservations ['6c327fc9-fd24-45a3-baac-524646a77016', '02a56aa9-b0f3-4b2b-ac86-9cc7e9682e05', '775070f1-ae97-43c4-b52e-94960ad102be', '312f9a86-4890-4a57-842d-f00b516f7e57'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:35:52 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d" returned: 0 in 0.410s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb66032-20e4-4230-aaba-87388c890104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c199b29-6a22-4d0e-8aca-e74d75d31bfb]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:52 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:35:52 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:52 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 Jul 31 07:35:52 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:53 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.345s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:35:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Deleted volume successfully. Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e3fc3d61-f258-494b-b43b-90874653e4aa tempest-TestStampPattern-1715021088 None] Lock "cinder-74c7e58a-6c53-4f35-b7dc-f32c4bca44ce-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:53 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-e6dc29ba-a0d0-44e7-afb6-683f1fe30369-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104" returned: 0 in 0.493s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Lock "cinder-e6dc29ba-a0d0-44e7-afb6-683f1fe30369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-quobyte-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:53 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 Jul 31 07:35:53 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-quobyte-e6dc29ba-a0d0-44e7-afb6-683f1fe30369" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-e6dc29ba-a0d0-44e7-afb6-683f1fe30369" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Deleting offline snapshot e6dc29ba-a0d0-44e7-afb6-683f1fe30369 of volume 2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] snapshot_file for this snap is: volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[79edb874-d625-4f65-8463-38673cac5ccd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:53 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 Jul 31 07:35:53 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:53 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369" returned: 0 in 0.523s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a3b74a-f477-4207-af81-d059eec5ce1d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:54 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 Jul 31 07:35:54 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:54 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" returned: 0 in 0.660s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:54 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 Jul 31 07:35:54 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:55 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369" returned: 0 in 0.790s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:55 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369 Jul 31 07:35:55 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:56 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841.e6dc29ba-a0d0-44e7-afb6-683f1fe30369" returned: 0 in 0.672s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-e6dc29ba-a0d0-44e7-afb6-683f1fe30369" released by "_delete_snapshot" :: held 2.864s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" released by "delete_snapshot" :: held 2.900s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:56 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Created reservations ['a1ab297b-c77a-4a85-b4f0-28ad2f85a82d', '8fcea3b3-9e17-46a2-a544-5a006393a26b', 'ba64e3c0-3471-4dfd-a894-2e740a63ce97', 'f40a114b-ffde-42cb-9b01-35cfc329ffd0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:35:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Delete snapshot completed successfully. Jul 31 07:35:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-070d2430-b9de-494d-a62f-fcb13aa336b2 tempest-TestStampPattern-1715021088 None] Lock "cinder-e6dc29ba-a0d0-44e7-afb6-683f1fe30369-delete_snapshot" released by "delete_snapshot" :: held 3.307s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:58 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71" returned: 0 in 5.247s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:58 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[142b6792-564c-4490-91d3-4d9aa3819240]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:35:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:58 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 Jul 31 07:35:58 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:59 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104" returned: 0 in 0.906s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:35:59 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Converted 1024.00 MB image at 195.11 MB/s Jul 31 07:35:59 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 is being set with open permissions: ugo+rw Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:35:59 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 Jul 31 07:35:59 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:35:59 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71" returned: 0 in 0.526s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-e505ca78-1294-4203-a95c-193b49487f71" released by "_copy_volume_from_snapshot" :: held 7.717s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-61692a08-9a22-44b3-92b6-7f030dc0220d-e505ca78-1294-4203-a95c-193b49487f71" released by "_create_volume_from_snapshot" :: held 7.751s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.769s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a141621-bfe2-4fc9-b706-5139f30c88c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e505ca78-1294-4203-a95c-193b49487f71', 'volume_size': 1, 'snapshot_id': '61692a08-9a22-44b3-92b6-7f030dc0220d'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2903025-659a-4914-a72c-48b866db993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:35:59 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Volume volume-e505ca78-1294-4203-a95c-193b49487f71 (e505ca78-1294-4203-a95c-193b49487f71): created successfully Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2903025-659a-4914-a72c-48b866db993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:35:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Flow 'volume_create_manager' (84ec47e9-69b0-456b-80b2-ad176662f022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:35:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7dc9d07b-68e4-4e5b-9041-dd104b2136da tempest-VolumeDependencyTests-287679459 None] Created volume successfully. Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-61692a08-9a22-44b3-92b6-7f030dc0220d-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-61692a08-9a22-44b3-92b6-7f030dc0220d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-quobyte-edb66032-20e4-4230-aaba-87388c890104" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-edb66032-20e4-4230-aaba-87388c890104" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-quobyte-61692a08-9a22-44b3-92b6-7f030dc0220d" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-61692a08-9a22-44b3-92b6-7f030dc0220d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Deleting offline snapshot 61692a08-9a22-44b3-92b6-7f030dc0220d of volume edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] snapshot_file for this snap is: volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4a0c77-e5c4-4ef4-95b0-6766e0c02d01]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:01 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d Jul 31 07:36:01 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:01 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d" returned: 0 in 0.501s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb66032-20e4-4230-aaba-87388c890104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7316aac6-ff83-49f3-91aa-4c633cccd493]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:01 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 Jul 31 07:36:01 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:02 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104" returned: 0 in 0.482s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:02 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d Jul 31 07:36:02 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:02 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d" returned: 0 in 0.375s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:02 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d Jul 31 07:36:02 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Lock "cinder-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Acquiring lock "cinder-quobyte-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e4049-cb02-45f5-9769-39be30776bce]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:03 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104.61692a08-9a22-44b3-92b6-7f030dc0220d" returned: 0 in 0.461s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-61692a08-9a22-44b3-92b6-7f030dc0220d" released by "_delete_snapshot" :: held 2.013s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-edb66032-20e4-4230-aaba-87388c890104" released by "delete_snapshot" :: held 2.043s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:03 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 Jul 31 07:36:03 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Created reservations ['c6856578-54f5-42bb-9953-caf59b6d7962', '7459205f-6c49-40a5-b714-54e409b3a040', 'ba185ec7-872a-4199-b776-fbd22339f980', '6b08ceef-fe70-4fb0-bcb3-f6cd0bfc470a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Delete snapshot completed successfully. Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a37d7bbb-fd79-4975-8c57-02a09aad28e5 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-61692a08-9a22-44b3-92b6-7f030dc0220d-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:03 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" returned: 0 in 0.524s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:03 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841 Jul 31 07:36:03 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:03 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" returned: 0 in 0.276s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Lock "cinder-quobyte-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841" released by "delete_volume" :: held 0.915s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Created reservations ['a2bcbd55-30e5-4e35-95bf-36d60496c506', '22f38eab-c7ab-4d9b-af49-6ad61ee06289', 'dbadd28a-7022-4a77-9a45-22ebdaefd76e', 'a5bca061-afe5-4d58-a5f4-88cf9a53f677'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:04 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:04 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:04 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.287s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Deleted volume successfully. Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-edb66032-20e4-4230-aaba-87388c890104-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6ddc6b53-a166-4f70-a89c-4c0f448f965d tempest-TestStampPattern-1715021088 None] Lock "cinder-2bba0dc0-4c8d-4d80-b0c8-dae0492f4841-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-edb66032-20e4-4230-aaba-87388c890104-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-quobyte-edb66032-20e4-4230-aaba-87388c890104" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-edb66032-20e4-4230-aaba-87388c890104" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d532d13c-d0a1-4c3c-9df5-8ed5190642fc]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:04 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 Jul 31 07:36:04 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:05 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104" returned: 0 in 0.579s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:05 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104 Jul 31 07:36:05 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:05 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-edb66032-20e4-4230-aaba-87388c890104" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-edb66032-20e4-4230-aaba-87388c890104" released by "delete_volume" :: held 0.945s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Created reservations ['a65ae32f-c908-49a6-9378-176d2df39663', '75ff7edf-5ef6-487f-a05a-3365b6c8403a', '3bf6ef70-d8df-4b76-bd31-3b257d05e918', '5d7134cd-3b58-4778-86b9-8fc107899b6c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:05 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:05 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-e505ca78-1294-4203-a95c-193b49487f71-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Lock "cinder-e505ca78-1294-4203-a95c-193b49487f71-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Acquiring lock "cinder-quobyte-e505ca78-1294-4203-a95c-193b49487f71" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-e505ca78-1294-4203-a95c-193b49487f71" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9d5d3-730d-456a-9704-4a903cd5e547]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:05 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 Jul 31 07:36:05 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:05 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.409s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:05 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Deleted volume successfully. Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4d148062-a671-4381-b9f1-18f482087d64 tempest-VolumeDependencyTests-287679459 None] Lock "cinder-edb66032-20e4-4230-aaba-87388c890104-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:06 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71" returned: 0 in 0.460s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:06 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71 Jul 31 07:36:06 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:06 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e505ca78-1294-4203-a95c-193b49487f71" returned: 0 in 0.326s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Lock "cinder-quobyte-e505ca78-1294-4203-a95c-193b49487f71" released by "delete_volume" :: held 0.863s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Created reservations ['fbe093e8-5a91-4065-a63a-f00556195ba1', 'dbb0b29c-b448-4a0e-b2e9-a65ec4afc31e', 'bf42e83e-a3b4-4ff3-9ef1-5a7d72d5cd17', 'adf826b5-d5b7-4094-877d-be0cf4cad280'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:06 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:06 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:07 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.360s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:07 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Deleted volume successfully. Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-34cd3467-b23f-4f32-b22d-4c0d3bdf9fbc tempest-VolumeDependencyTests-287679459 None] Lock "cinder-e505ca78-1294-4203-a95c-193b49487f71-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Flow 'volume_create_manager' (198938ff-6593-4981-85dd-b9660596bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b66ca21-07d3-4838-8f14-2bbb9c9778e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b66ca21-07d3-4838-8f14-2bbb9c9778e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1617319796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab4d5ed-9d23-4155-bf50-79ebb00db18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84beb56808f746c9bc8cd4a3b8cadd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:08Z,use_quota=True,user_id='b17aec057056447a9c940080f3c0a2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986345d6-c93d-4f13-a36f-1b9e420918da),volume_type_id=986345d6-c93d-4f13-a36f-1b9e420918da)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9626d1-122e-4f9d-87d0-d47b6be131b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9626d1-122e-4f9d-87d0-d47b6be131b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c10322-a187-4d67-8e6e-ddf80d6a6739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c10322-a187-4d67-8e6e-ddf80d6a6739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab4d5ed-9d23-4155-bf50-79ebb00db18d', 'volume_name': 'volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9948d82b-69c7-4dda-b176-7ed660bdd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9948d82b-69c7-4dda-b176-7ed660bdd357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adfe5b7-281c-4582-b0b6-c41de4964ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:07 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Volume aab4d5ed-9d23-4155-bf50-79ebb00db18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d', 'volume_size': 1} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1617319796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab4d5ed-9d23-4155-bf50-79ebb00db18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84beb56808f746c9bc8cd4a3b8cadd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:08Z,use_quota=True,user_id='b17aec057056447a9c940080f3c0a2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986345d6-c93d-4f13-a36f-1b9e420918da),volume_type_id=986345d6-c93d-4f13-a36f-1b9e420918da)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Creating volume aab4d5ed-9d23-4155-bf50-79ebb00db18d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:07 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:07 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d 1073741824 Jul 31 07:36:07 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Flow 'volume_create_manager' (a1f753e9-9e2c-40c4-95a4-3c5a8f0cc7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2404190-969d-46a6-b836-4dfd64ba5db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2404190-969d-46a6-b836-4dfd64ba5db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1508348976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d9add6-2fbf-4153-a30b-36d26d1ab019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84beb56808f746c9bc8cd4a3b8cadd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:08Z,use_quota=True,user_id='b17aec057056447a9c940080f3c0a2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bdaa53b-0efd-42b5-af67-08f6f25caa65),volume_type_id=1bdaa53b-0efd-42b5-af67-08f6f25caa65)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141aed23-6bd8-44d3-b922-4c1eec96d429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:08 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141aed23-6bd8-44d3-b922-4c1eec96d429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b758e33f-5da9-4d7c-9bb7-94c7c4a22b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b758e33f-5da9-4d7c-9bb7-94c7c4a22b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d9add6-2fbf-4153-a30b-36d26d1ab019', 'volume_name': 'volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82a06fc-6ad2-4d1c-aa01-b1de24b506e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82a06fc-6ad2-4d1c-aa01-b1de24b506e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c4ce9-8f19-4275-8f24-9f735b6c9c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:08 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Volume f4d9add6-2fbf-4153-a30b-36d26d1ab019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019', 'volume_size': 1} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d 1073741824" returned: 0 in 0.726s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:08 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d Jul 31 07:36:08 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:09 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d" returned: 0 in 0.335s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1508348976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d9add6-2fbf-4153-a30b-36d26d1ab019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84beb56808f746c9bc8cd4a3b8cadd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:08Z,use_quota=True,user_id='b17aec057056447a9c940080f3c0a2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bdaa53b-0efd-42b5-af67-08f6f25caa65),volume_type_id=1bdaa53b-0efd-42b5-af67-08f6f25caa65)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Creating volume f4d9add6-2fbf-4153-a30b-36d26d1ab019 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:09 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adfe5b7-281c-4582-b0b6-c41de4964ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f9d551-cbf4-484c-87db-c0d3994408bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:09 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 1073741824 Jul 31 07:36:09 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Volume volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d (aab4d5ed-9d23-4155-bf50-79ebb00db18d): created successfully Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f9d551-cbf4-484c-87db-c0d3994408bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Flow 'volume_create_manager' (198938ff-6593-4981-85dd-b9660596bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6967ca36-0b79-40d2-b979-872f547f331f tempest-TestInstancesWithCinderVolumes-538694990 None] Created volume successfully. Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Flow 'volume_create_manager' (5d9934f5-095a-475f-ad6f-1e2a0d786d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdd526e-fe80-46f5-b297-449273db3681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdd526e-fe80-46f5-b297-449273db3681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1362371896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df376e9d-3d3f-4dc2-b502-1331fb6b81b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84beb56808f746c9bc8cd4a3b8cadd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:09Z,use_quota=True,user_id='b17aec057056447a9c940080f3c0a2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d7d1fb8-d7e9-4363-b39e-2c6070b51163),volume_type_id=2d7d1fb8-d7e9-4363-b39e-2c6070b51163)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dd6870-57d1-4aa4-8019-1bc7e3fa2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dd6870-57d1-4aa4-8019-1bc7e3fa2132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faee5987-6d1a-4161-95c5-da4ffc607876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:36:09 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 1073741824" returned: 0 in 0.684s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:09 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 Jul 31 07:36:09 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:10 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019" returned: 0 in 0.340s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c4ce9-8f19-4275-8f24-9f735b6c9c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002a468e-ab04-4dff-886e-6d1b24b2d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Volume volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 (f4d9add6-2fbf-4153-a30b-36d26d1ab019): created successfully Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002a468e-ab04-4dff-886e-6d1b24b2d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Flow 'volume_create_manager' (a1f753e9-9e2c-40c4-95a4-3c5a8f0cc7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faee5987-6d1a-4161-95c5-da4ffc607876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df376e9d-3d3f-4dc2-b502-1331fb6b81b2', 'volume_name': 'volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2', 'volume_size': 1, 'image_id': '3a8ec2be-6eec-417c-a178-6289a754be9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a8ec2be-6eec-417c-a178-6289a754be9a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1983658328', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84beb56808f746c9bc8cd4a3b8cadd7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a8ec2be-6eec-417c-a178-6289a754be9a', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a8ec2be-6eec-417c-a178-6289a754be9a/file', 'properties': {}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04fe380-accf-4f28-91b1-899d57b5574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04fe380-accf-4f28-91b1-899d57b5574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f5de62-2326-4977-9479-ce2908801080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Volume df376e9d-3d3f-4dc2-b502-1331fb6b81b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2', 'volume_size': 1, 'image_id': '3a8ec2be-6eec-417c-a178-6289a754be9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a8ec2be-6eec-417c-a178-6289a754be9a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1983658328', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84beb56808f746c9bc8cd4a3b8cadd7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a8ec2be-6eec-417c-a178-6289a754be9a', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a8ec2be-6eec-417c-a178-6289a754be9a/file', 'properties': {}}, 'image_service': } Jul 31 07:36:10 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Trying to clone df376e9d-3d3f-4dc2-b502-1331fb6b81b2 from image 3a8ec2be-6eec-417c-a178-6289a754be9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a8ec2be-6eec-417c-a178-6289a754be9a', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:36:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a47ab6a1-f131-4111-9004-22a390b44d99 tempest-TestInstancesWithCinderVolumes-538694990 None] Created volume successfully. Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD, size 20.69 MB, duration 3.42 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:36:13 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Image download 20.69 MB at 6.05 MB/s Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d1a918-e138-42a6-8e57-5e0dec32334c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Flow 'volume_create_manager' (278116cb-bfd6-457f-93cd-001081d2e886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6be27f3-2d34-4867-a8ac-2d5118754c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6be27f3-2d34-4867-a8ac-2d5118754c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda42d80-65d4-44c5-9d4d-f05fe536f9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30609e1b8d214e7bbdb09188494c21db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:14Z,use_quota=True,user_id='6c5f49c3408d4c109232d536231fbdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6081ca-819e-46b7-bb86-ff3594cf885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6081ca-819e-46b7-bb86-ff3594cf885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:13 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428e32fb-ab98-4589-b912-28ba2e6effb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:13 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:13 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:36:14 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Temporary image 3a8ec2be-6eec-417c-a178-6289a754be9a is fetched for user b17aec057056447a9c940080f3c0a2b4. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428e32fb-ab98-4589-b912-28ba2e6effb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bda42d80-65d4-44c5-9d4d-f05fe536f9e4', 'volume_name': 'volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4', 'volume_size': 1, 'image_id': 'bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cdcff9a2b6a382630126685811c9e80', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30609e1b8d214e7bbdb09188494c21db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8ef8d69e5315ccd93a45268eb40cba92baf4084716378ca3e8914e63617635f490210a7c8606624e9f7bde4162327a342f717535985b1e7981f4820de5f18dc', 'id': 'bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5/file', 'properties': {}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730c6791-37eb-4360-ba05-57ff5d83ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730c6791-37eb-4360-ba05-57ff5d83ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b7203e-7239-44d7-8735-124739ecc806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Volume bda42d80-65d4-44c5-9d4d-f05fe536f9e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4', 'volume_size': 1, 'image_id': 'bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cdcff9a2b6a382630126685811c9e80', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30609e1b8d214e7bbdb09188494c21db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8ef8d69e5315ccd93a45268eb40cba92baf4084716378ca3e8914e63617635f490210a7c8606624e9f7bde4162327a342f717535985b1e7981f4820de5f18dc', 'id': 'bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5/file', 'properties': {}}, 'image_service': } Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Trying to clone bda42d80-65d4-44c5-9d4d-f05fe536f9e4 from image bcbdb04f-f456-4863-b253-a8e8e149d5c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[180daab9-1bac-4c6b-a024-529201d64d09]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:36:14 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Image download 0.00 MB at 0.00 MB/s Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb20e11e-b9d6-42d7-b057-27a049201c79]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:14 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD Jul 31 07:36:14 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:14 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD Jul 31 07:36:14 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:14 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1362371896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df376e9d-3d3f-4dc2-b502-1331fb6b81b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84beb56808f746c9bc8cd4a3b8cadd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:09Z,use_quota=True,user_id='b17aec057056447a9c940080f3c0a2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d7d1fb8-d7e9-4363-b39e-2c6070b51163),volume_type_id=2d7d1fb8-d7e9-4363-b39e-2c6070b51163)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Creating volume df376e9d-3d3f-4dc2-b502-1331fb6b81b2 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:14 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:14 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 1073741824 Jul 31 07:36:14 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:14 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:15 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD Jul 31 07:36:15 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:15 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 1073741824" returned: 0 in 0.552s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:15 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD" returned: 1 in 0.420s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Temporary image bcbdb04f-f456-4863-b253-a8e8e149d5c5 is fetched for user 6c5f49c3408d4c109232d536231fbdae. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:15 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 Jul 31 07:36:15 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[40da49f0-63d3-45ed-ba6e-77986adc1c39]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:15 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD Jul 31 07:36:15 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:15 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2" returned: 0 in 0.267s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Attempting download of 3a8ec2be-6eec-417c-a178-6289a754be9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3a8ec2be-6eec-417c-a178-6289a754be9a', 'metadata': {}}])) to volume df376e9d-3d3f-4dc2-b502-1331fb6b81b2. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aebe50-be57-46f1-8c15-ab262bdc239d]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a8ec2be-6eec-417c-a178-6289a754be9a_3sfmydp1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:15 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:15 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a8ec2be-6eec-417c-a178-6289a754be9a_3sfmydp1 Jul 31 07:36:15 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:15 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD Jul 31 07:36:15 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:16 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a8ec2be-6eec-417c-a178-6289a754be9a_3sfmydp1" returned: 0 in 0.463s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a8ec2be-6eec-417c-a178-6289a754be9a_3sfmydp1 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:16 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD" returned: 1 in 0.443s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda42d80-65d4-44c5-9d4d-f05fe536f9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30609e1b8d214e7bbdb09188494c21db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:14Z,use_quota=True,user_id='6c5f49c3408d4c109232d536231fbdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Creating volume bda42d80-65d4-44c5-9d4d-f05fe536f9e4 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:16 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:16 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a8ec2be-6eec-417c-a178-6289a754be9a_3sfmydp1 Jul 31 07:36:16 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 1073741824 Jul 31 07:36:16 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:16 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:16 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a8ec2be-6eec-417c-a178-6289a754be9a_3sfmydp1" returned: 1 in 0.365s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a8ec2be-6eec-417c-a178-6289a754be9a_3sfmydp1' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153ef29-bb03-4a8f-b4bf-a3588f7a8239]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:16 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD Jul 31 07:36:16 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:16 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 1073741824" returned: 0 in 0.512s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:16 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 Jul 31 07:36:16 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:16 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] 3a8ec2be-6eec-417c-a178-6289a754be9a was qcow2, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:36:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:16 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 Jul 31 07:36:16 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:17 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4" returned: 0 in 0.306s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Attempting download of bcbdb04f-f456-4863-b253-a8e8e149d5c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'metadata': {}}])) to volume bda42d80-65d4-44c5-9d4d-f05fe536f9e4. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f702c0-fa9f-4939-8870-7c1dce1fc5d0]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcbdb04f-f456-4863-b253-a8e8e149d5c5_ziqe8mh8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:17 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcbdb04f-f456-4863-b253-a8e8e149d5c5_ziqe8mh8 Jul 31 07:36:17 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:17 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcbdb04f-f456-4863-b253-a8e8e149d5c5_ziqe8mh8" returned: 0 in 0.406s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcbdb04f-f456-4863-b253-a8e8e149d5c5_ziqe8mh8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:17 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcbdb04f-f456-4863-b253-a8e8e149d5c5_ziqe8mh8 Jul 31 07:36:17 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:17 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcbdb04f-f456-4863-b253-a8e8e149d5c5_ziqe8mh8" returned: 1 in 0.369s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcbdb04f-f456-4863-b253-a8e8e149d5c5_ziqe8mh8' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[377c7d43-ff96-4cdf-8d90-aa349698bf8d]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:18 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD Jul 31 07:36:18 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:18 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:18 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD Jul 31 07:36:18 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:18 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] bcbdb04f-f456-4863-b253-a8e8e149d5c5 was raw, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:18 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 Jul 31 07:36:18 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:18 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2" returned: 0 in 1.946s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a8ec2be-6eec-417c-a178-6289a754be9a_0feinzr3devstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:36:18 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Converted 112.00 MB image at 57.43 MB/s Jul 31 07:36:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:18 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 1G Jul 31 07:36:18 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:19 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 1G" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Downloaded image 3a8ec2be-6eec-417c-a178-6289a754be9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3a8ec2be-6eec-417c-a178-6289a754be9a', 'metadata': {}}])) to volume df376e9d-3d3f-4dc2-b502-1331fb6b81b2 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Temporary image 3a8ec2be-6eec-417c-a178-6289a754be9a for user b17aec057056447a9c940080f3c0a2b4 is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Marking volume df376e9d-3d3f-4dc2-b502-1331fb6b81b2 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Copying metadata from image 3a8ec2be-6eec-417c-a178-6289a754be9a to df376e9d-3d3f-4dc2-b502-1331fb6b81b2. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Creating volume glance metadata for volume df376e9d-3d3f-4dc2-b502-1331fb6b81b2 backed by image 3a8ec2be-6eec-417c-a178-6289a754be9a with: {'image_id': '3a8ec2be-6eec-417c-a178-6289a754be9a', 'image_name': 'tempest-scenario-img--1983658328', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:36:19 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4" returned: 0 in 0.514s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcbdb04f-f456-4863-b253-a8e8e149d5c5_j0pwncm2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:36:19 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:19 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 1G Jul 31 07:36:19 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f5de62-2326-4977-9479-ce2908801080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2', 'volume_size': 1, 'image_id': '3a8ec2be-6eec-417c-a178-6289a754be9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a8ec2be-6eec-417c-a178-6289a754be9a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1983658328', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84beb56808f746c9bc8cd4a3b8cadd7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a8ec2be-6eec-417c-a178-6289a754be9a', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a8ec2be-6eec-417c-a178-6289a754be9a/file', 'properties': {}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae8197d-fc45-445d-a9dc-0231000e6e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Volume volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 (df376e9d-3d3f-4dc2-b502-1331fb6b81b2): created successfully Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae8197d-fc45-445d-a9dc-0231000e6e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Flow 'volume_create_manager' (5d9934f5-095a-475f-ad6f-1e2a0d786d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-49932d8a-f62b-4ee1-97c0-4c66086a86f7 tempest-TestInstancesWithCinderVolumes-538694990 None] Created volume successfully. Jul 31 07:36:19 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 1G" returned: 0 in 0.303s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Downloaded image bcbdb04f-f456-4863-b253-a8e8e149d5c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'metadata': {}}])) to volume bda42d80-65d4-44c5-9d4d-f05fe536f9e4 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Temporary image bcbdb04f-f456-4863-b253-a8e8e149d5c5 for user 6c5f49c3408d4c109232d536231fbdae is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Marking volume bda42d80-65d4-44c5-9d4d-f05fe536f9e4 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Copying metadata from image bcbdb04f-f456-4863-b253-a8e8e149d5c5 to bda42d80-65d4-44c5-9d4d-f05fe536f9e4. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Creating volume glance metadata for volume bda42d80-65d4-44c5-9d4d-f05fe536f9e4 backed by image bcbdb04f-f456-4863-b253-a8e8e149d5c5 with: {'image_id': 'bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6cdcff9a2b6a382630126685811c9e80', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b7203e-7239-44d7-8735-124739ecc806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4', 'volume_size': 1, 'image_id': 'bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cdcff9a2b6a382630126685811c9e80', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30609e1b8d214e7bbdb09188494c21db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8ef8d69e5315ccd93a45268eb40cba92baf4084716378ca3e8914e63617635f490210a7c8606624e9f7bde4162327a342f717535985b1e7981f4820de5f18dc', 'id': 'bcbdb04f-f456-4863-b253-a8e8e149d5c5', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcbdb04f-f456-4863-b253-a8e8e149d5c5/file', 'properties': {}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473d9abd-3a7a-450a-8c88-6794e2dae58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Volume volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 (bda42d80-65d4-44c5-9d4d-f05fe536f9e4): created successfully Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473d9abd-3a7a-450a-8c88-6794e2dae58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Flow 'volume_create_manager' (278116cb-bfd6-457f-93cd-001081d2e886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-00cb8883-d902-46db-a1ce-40a435fdf043 tempest-VolumeImageDependencyTests-655300091 None] Created volume successfully. Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Acquiring lock "cinder-bda42d80-65d4-44c5-9d4d-f05fe536f9e4-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Lock "cinder-bda42d80-65d4-44c5-9d4d-f05fe536f9e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Acquiring lock "cinder-quobyte-bda42d80-65d4-44c5-9d4d-f05fe536f9e4" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Lock "cinder-quobyte-bda42d80-65d4-44c5-9d4d-f05fe536f9e4" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a90f54f-4de8-43db-a113-c47d855f9d39]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:20 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 Jul 31 07:36:20 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:20 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4" returned: 0 in 0.432s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:20 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4 Jul 31 07:36:20 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:21 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bda42d80-65d4-44c5-9d4d-f05fe536f9e4" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Lock "cinder-quobyte-bda42d80-65d4-44c5-9d4d-f05fe536f9e4" released by "delete_volume" :: held 0.779s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Created reservations ['9be3f021-fcef-40b5-aa6e-d6e1b6af1a41', '4549e8a8-3797-4097-b6e3-a219b42cf002', '3525e85b-1116-4f1a-9430-786a6537124f', '42d75dc5-105f-4be0-9580-aa864c39aca4'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:21 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:21 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:21 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.340s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Deleted volume successfully. Jul 31 07:36:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-032fb0ae-c16e-48d1-8521-40231103ecbe tempest-VolumeImageDependencyTests-655300091 None] Lock "cinder-bda42d80-65d4-44c5-9d4d-f05fe536f9e4-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:22 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Flow 'volume_create_manager' (1471e2fa-ab81-4b6d-b1f8-56dd3a832695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc566a4e-2c3c-4b86-9485-a3b50bfef4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc566a4e-2c3c-4b86-9485-a3b50bfef4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fc0adf-aa3b-4eae-a177-730e8072e1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15556956501f426993c27b8c0d63cae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:23Z,use_quota=True,user_id='4c7a31dd9f83446fb42f383f3a74532c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d768cb72-3257-42aa-8e65-bc29519cfc34),volume_type_id=d768cb72-3257-42aa-8e65-bc29519cfc34)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8921ea97-eb84-410c-93d2-96f9fbfb27e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8921ea97-eb84-410c-93d2-96f9fbfb27e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b213f7f-10b1-49ac-9ad0-3d17f051ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-821858d5-36ca-4a54-a02a-0d73fda6ab7d req-7832e6b7-cdc1-4324-a8e7-e790652b5f29 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-821858d5-36ca-4a54-a02a-0d73fda6ab7d req-7832e6b7-cdc1-4324-a8e7-e790652b5f29 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-821858d5-36ca-4a54-a02a-0d73fda6ab7d req-7832e6b7-cdc1-4324-a8e7-e790652b5f29 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-821858d5-36ca-4a54-a02a-0d73fda6ab7d req-7832e6b7-cdc1-4324-a8e7-e790652b5f29 tempest-TestInstancesWithCinderVolumes-538694990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9263e7a-2b37-4573-b80f-9c43893b4935', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:36:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-821858d5-36ca-4a54-a02a-0d73fda6ab7d req-7832e6b7-cdc1-4324-a8e7-e790652b5f29 tempest-TestInstancesWithCinderVolumes-538694990 None] attachment_update completed successfully. Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b213f7f-10b1-49ac-9ad0-3d17f051ff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40fc0adf-aa3b-4eae-a177-730e8072e1f4', 'volume_name': 'volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4', 'volume_size': 1, 'image_id': 'f55f4e3f-978d-4525-901f-da693ed608c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f55f4e3f-978d-4525-901f-da693ed608c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7a9ecfb2d2dff9abe1817f6aa681c15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15556956501f426993c27b8c0d63cae5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a17dcc1f12c7582ff2dfe448226db452eaaf972174f8997b6a45c8030838b976f4ece582668067a7471b4e61f31ab6f15cabe8d10970a8b55763aec2ca437fb', 'id': 'f55f4e3f-978d-4525-901f-da693ed608c9', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f55f4e3f-978d-4525-901f-da693ed608c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25762f53-0f60-45e7-9f7a-41d179451fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25762f53-0f60-45e7-9f7a-41d179451fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375ff8c9-1423-4ed1-9a07-253895c70631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:23 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Volume 40fc0adf-aa3b-4eae-a177-730e8072e1f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4', 'volume_size': 1, 'image_id': 'f55f4e3f-978d-4525-901f-da693ed608c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f55f4e3f-978d-4525-901f-da693ed608c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7a9ecfb2d2dff9abe1817f6aa681c15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15556956501f426993c27b8c0d63cae5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a17dcc1f12c7582ff2dfe448226db452eaaf972174f8997b6a45c8030838b976f4ece582668067a7471b4e61f31ab6f15cabe8d10970a8b55763aec2ca437fb', 'id': 'f55f4e3f-978d-4525-901f-da693ed608c9', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f55f4e3f-978d-4525-901f-da693ed608c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Trying to clone 40fc0adf-aa3b-4eae-a177-730e8072e1f4 from image f55f4e3f-978d-4525-901f-da693ed608c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f55f4e3f-978d-4525-901f-da693ed608c9', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:36:23 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Image download 0.00 MB at 0.00 MB/s Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a23c05-c7ba-4765-90ab-bd9492fa9087]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:24 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD Jul 31 07:36:24 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:24 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:24 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD Jul 31 07:36:24 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:24 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:24 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Temporary image f55f4e3f-978d-4525-901f-da693ed608c9 is fetched for user 4c7a31dd9f83446fb42f383f3a74532c. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:36:24 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da52fb-c01a-4747-869c-d82a2fccfcfc]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:24 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD Jul 31 07:36:24 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:25 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:25 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD Jul 31 07:36:25 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:25 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fc0adf-aa3b-4eae-a177-730e8072e1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15556956501f426993c27b8c0d63cae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:23Z,use_quota=True,user_id='4c7a31dd9f83446fb42f383f3a74532c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d768cb72-3257-42aa-8e65-bc29519cfc34),volume_type_id=d768cb72-3257-42aa-8e65-bc29519cfc34)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Creating volume 40fc0adf-aa3b-4eae-a177-730e8072e1f4 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:25 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:25 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 1073741824 Jul 31 07:36:25 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:26 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 1073741824" returned: 0 in 0.738s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:26 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 Jul 31 07:36:26 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:26 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4" returned: 0 in 0.415s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:26 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Attempting download of f55f4e3f-978d-4525-901f-da693ed608c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/f55f4e3f-978d-4525-901f-da693ed608c9', 'metadata': {}}])) to volume 40fc0adf-aa3b-4eae-a177-730e8072e1f4. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:36:26 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Flow 'volume_create_manager' (e0e1b10d-8670-47cd-87fc-87a780eaf3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e2fd84-6971-4bec-ac5d-b4e5e9969ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e2fd84-6971-4bec-ac5d-b4e5e9969ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172662831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365f10cf-cb09-4c4d-959d-c89873761741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbfa5f4fee8c47b1bbc94511bbb5bcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:27Z,use_quota=True,user_id='e29c174ae3bb4bd691ba28006cef8ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bfddb4-861f-4ad7-9c35-bc0e25c55359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bfddb4-861f-4ad7-9c35-bc0e25c55359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7620fe-518e-47b4-860c-6c29e4fa4961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7620fe-518e-47b4-860c-6c29e4fa4961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365f10cf-cb09-4c4d-959d-c89873761741', 'volume_name': 'volume-365f10cf-cb09-4c4d-959d-c89873761741', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8067c42-23b5-43c1-acfa-a1ab9ec64e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8067c42-23b5-43c1-acfa-a1ab9ec64e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27013c15-bdec-4b1b-8af5-3b5aca452304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:27 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Volume 365f10cf-cb09-4c4d-959d-c89873761741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365f10cf-cb09-4c4d-959d-c89873761741', 'volume_size': 1} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172662831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365f10cf-cb09-4c4d-959d-c89873761741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbfa5f4fee8c47b1bbc94511bbb5bcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:27Z,use_quota=True,user_id='e29c174ae3bb4bd691ba28006cef8ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Creating volume 365f10cf-cb09-4c4d-959d-c89873761741 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:27 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[53456720-9e78-4343-ae46-86f36ab4efa5]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f55f4e3f-978d-4525-901f-da693ed608c9_0as6p676 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:27 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 1073741824 Jul 31 07:36:27 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:27 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f55f4e3f-978d-4525-901f-da693ed608c9_0as6p676 Jul 31 07:36:27 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:27 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f55f4e3f-978d-4525-901f-da693ed608c9_0as6p676" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f55f4e3f-978d-4525-901f-da693ed608c9_0as6p676 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:27 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f55f4e3f-978d-4525-901f-da693ed608c9_0as6p676 Jul 31 07:36:27 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:27 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 1073741824" returned: 0 in 0.534s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:27 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 Jul 31 07:36:27 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:27 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f55f4e3f-978d-4525-901f-da693ed608c9_0as6p676" returned: 1 in 0.365s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f55f4e3f-978d-4525-901f-da693ed608c9_0as6p676' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525f8ae-6fe7-4339-ad2a-013f907a4b05]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:28 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:28 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD Jul 31 07:36:28 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27013c15-bdec-4b1b-8af5-3b5aca452304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365f10cf-cb09-4c4d-959d-c89873761741', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e734805-8fae-46f8-853a-8ef718410f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=102,cinder:UPDATE=104,cinder:INSERT=33,cinder:DELETE=11 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:36:28 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Volume volume-365f10cf-cb09-4c4d-959d-c89873761741 (365f10cf-cb09-4c4d-959d-c89873761741): created successfully Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e734805-8fae-46f8-853a-8ef718410f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Flow 'volume_create_manager' (e0e1b10d-8670-47cd-87fc-87a780eaf3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f45ec7e9-2a1c-4f08-81e8-862e4c20f603 tempest-ProjectReaderTests-574885753 None] Created volume successfully. Jul 31 07:36:28 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:28 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD Jul 31 07:36:28 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:28 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] f55f4e3f-978d-4525-901f-da693ed608c9 was raw, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:36:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:28 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 Jul 31 07:36:28 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:29 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4" returned: 0 in 0.650s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f55f4e3f-978d-4525-901f-da693ed608c9_ssn4o_cadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:36:29 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Acquiring lock "cinder-365f10cf-cb09-4c4d-959d-c89873761741-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:29 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 1G Jul 31 07:36:29 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Lock "cinder-365f10cf-cb09-4c4d-959d-c89873761741-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=98,cinder:UPDATE=115,cinder:INSERT=35,cinder:DELETE=6 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Acquiring lock "cinder-quobyte-365f10cf-cb09-4c4d-959d-c89873761741" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Lock "cinder-quobyte-365f10cf-cb09-4c4d-959d-c89873761741" acquired by "delete_volume" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5aa3bc-e611-4556-bcce-e8b7ee0465b8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:29 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 Jul 31 07:36:29 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:29 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 1G" returned: 0 in 0.465s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Downloaded image f55f4e3f-978d-4525-901f-da693ed608c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/f55f4e3f-978d-4525-901f-da693ed608c9', 'metadata': {}}])) to volume 40fc0adf-aa3b-4eae-a177-730e8072e1f4 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Temporary image f55f4e3f-978d-4525-901f-da693ed608c9 for user 4c7a31dd9f83446fb42f383f3a74532c is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Marking volume 40fc0adf-aa3b-4eae-a177-730e8072e1f4 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Copying metadata from image f55f4e3f-978d-4525-901f-da693ed608c9 to 40fc0adf-aa3b-4eae-a177-730e8072e1f4. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Creating volume glance metadata for volume 40fc0adf-aa3b-4eae-a177-730e8072e1f4 backed by image f55f4e3f-978d-4525-901f-da693ed608c9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f55f4e3f-978d-4525-901f-da693ed608c9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd7a9ecfb2d2dff9abe1817f6aa681c15', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375ff8c9-1423-4ed1-9a07-253895c70631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4', 'volume_size': 1, 'image_id': 'f55f4e3f-978d-4525-901f-da693ed608c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f55f4e3f-978d-4525-901f-da693ed608c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7a9ecfb2d2dff9abe1817f6aa681c15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15556956501f426993c27b8c0d63cae5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a17dcc1f12c7582ff2dfe448226db452eaaf972174f8997b6a45c8030838b976f4ece582668067a7471b4e61f31ab6f15cabe8d10970a8b55763aec2ca437fb', 'id': 'f55f4e3f-978d-4525-901f-da693ed608c9', 'created_at': datetime.datetime(2026, 7, 31, 5, 36, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 36, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f55f4e3f-978d-4525-901f-da693ed608c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6578fdbd-90b6-40fe-baf9-ad4fa8619c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:29 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Volume volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 (40fc0adf-aa3b-4eae-a177-730e8072e1f4): created successfully Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6578fdbd-90b6-40fe-baf9-ad4fa8619c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Flow 'volume_create_manager' (1471e2fa-ab81-4b6d-b1f8-56dd3a832695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1525d74c-633b-4ed7-ac32-f543b2acc584 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Created volume successfully. Jul 31 07:36:30 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741" returned: 0 in 0.482s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:30 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741 Jul 31 07:36:30 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:30 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-365f10cf-cb09-4c4d-959d-c89873761741" returned: 0 in 0.269s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Lock "cinder-quobyte-365f10cf-cb09-4c4d-959d-c89873761741" released by "delete_volume" :: held 0.815s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Created reservations ['374830b7-60f6-476b-a015-6bed4d8d1a22', 'bff2e3ba-8794-4c69-8393-886b6743b500', 'ca16fa97-c07a-433c-a2f7-2345a9a179d3', '7142cf78-55a0-4320-b38a-636953613ca0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:30 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:30 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Acquiring lock "cinder-40fc0adf-aa3b-4eae-a177-730e8072e1f4-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "cinder-40fc0adf-aa3b-4eae-a177-730e8072e1f4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Acquiring lock "cinder-quobyte-40fc0adf-aa3b-4eae-a177-730e8072e1f4" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "cinder-quobyte-40fc0adf-aa3b-4eae-a177-730e8072e1f4" acquired by "delete_volume" :: waited 0.043s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9389c1f-7fdc-4e6f-930f-513396cdfb3c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:31 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 Jul 31 07:36:31 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:31 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.820s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:31 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Deleted volume successfully. Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0e7c216e-9204-4de9-94ac-3b1cb6466b34 tempest-ProjectReaderTests-574885753 None] Lock "cinder-365f10cf-cb09-4c4d-959d-c89873761741-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Flow 'volume_create_manager' (077e86b4-3d0a-4530-a242-7e5266fb188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bade65f-b0f7-423b-b735-505519a3b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bade65f-b0f7-423b-b735-505519a3b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657648235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ddb58e-187e-4542-afe2-4d15770ccc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbfa5f4fee8c47b1bbc94511bbb5bcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:32Z,use_quota=True,user_id='e29c174ae3bb4bd691ba28006cef8ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce66bc0-8326-47be-9bfc-c15235a2f680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce66bc0-8326-47be-9bfc-c15235a2f680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181c6193-387a-4285-a19e-a9d2ec82b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:31 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181c6193-387a-4285-a19e-a9d2ec82b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ddb58e-187e-4542-afe2-4d15770ccc2d', 'volume_name': 'volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb119db9-a2ed-49f3-8ee4-1a3114a93947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb119db9-a2ed-49f3-8ee4-1a3114a93947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73a73c5-d29a-4222-9d21-13b7413a938a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:31 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Volume a9ddb58e-187e-4542-afe2-4d15770ccc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d', 'volume_size': 1} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657648235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ddb58e-187e-4542-afe2-4d15770ccc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbfa5f4fee8c47b1bbc94511bbb5bcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:32Z,use_quota=True,user_id='e29c174ae3bb4bd691ba28006cef8ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Creating volume a9ddb58e-187e-4542-afe2-4d15770ccc2d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:31 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4" returned: 0 in 0.856s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:31 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d 1073741824 Jul 31 07:36:31 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:31 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4 Jul 31 07:36:31 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:32 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-40fc0adf-aa3b-4eae-a177-730e8072e1f4" returned: 0 in 0.435s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "cinder-quobyte-40fc0adf-aa3b-4eae-a177-730e8072e1f4" released by "delete_volume" :: held 1.419s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:32 devstack cinder-volume[88915]: WARNING cinder.quota [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:36:32 devstack cinder-volume[88915]: WARNING cinder.quota [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Created reservations ['e2af957b-05a0-471a-84d9-9f8b808bb7d7', '0acd4891-75af-4f7c-8cb2-0eb9ab794025', '85bbcc6d-4c35-4b19-b310-c7a0eabffc4d', 'e48fd0ba-b034-4f1e-9fda-fa9278d0013a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:32 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d 1073741824" returned: 0 in 0.733s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:32 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:32 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:32 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d Jul 31 07:36:32 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:32 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.337s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:32 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Deleted volume successfully. Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bc19a909-5e34-430d-bfcc-97e439ce9718 tempest-VolumeAndVolumeTypeFromImageTest-635691632 None] Lock "cinder-40fc0adf-aa3b-4eae-a177-730e8072e1f4-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:32 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d" returned: 0 in 0.335s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73a73c5-d29a-4222-9d21-13b7413a938a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af0d0e-474b-44e9-b8d1-a1cc60d66614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:33 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Volume volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d (a9ddb58e-187e-4542-afe2-4d15770ccc2d): created successfully Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af0d0e-474b-44e9-b8d1-a1cc60d66614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Flow 'volume_create_manager' (077e86b4-3d0a-4530-a242-7e5266fb188c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-67fe3e4f-dec2-4f2e-b7c2-ab0d27c7fb54 tempest-ProjectReaderTests-574885753 None] Created volume successfully. Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:33 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:33 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Acquiring lock "cinder-a9ddb58e-187e-4542-afe2-4d15770ccc2d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Lock "cinder-a9ddb58e-187e-4542-afe2-4d15770ccc2d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Acquiring lock "cinder-quobyte-a9ddb58e-187e-4542-afe2-4d15770ccc2d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Lock "cinder-quobyte-a9ddb58e-187e-4542-afe2-4d15770ccc2d" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c00d121-7549-4894-928f-0e700c625f81]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:34 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.590s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:36:34 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d Jul 31 07:36:34 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:34 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d" returned: 0 in 0.697s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:35 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d Jul 31 07:36:35 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:35 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a9ddb58e-187e-4542-afe2-4d15770ccc2d" returned: 0 in 0.419s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Lock "cinder-quobyte-a9ddb58e-187e-4542-afe2-4d15770ccc2d" released by "delete_volume" :: held 1.217s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Created reservations ['34f2d696-2588-4547-9b63-6a833ece4aac', '7e0d7721-5317-4cca-b228-10852e8dc5c3', 'b24864d5-7a8f-457f-983b-55437c227087', '6ec7db00-a38c-49a5-8440-220d47f8883f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:35 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:35 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:35 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.349s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:35 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Deleted volume successfully. Jul 31 07:36:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0212dc7d-4000-4cf5-ba23-997dd40b5227 tempest-ProjectReaderTests-574885753 None] Lock "cinder-a9ddb58e-187e-4542-afe2-4d15770ccc2d-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (81b2fc3d-99bb-4110-b69c-26837477a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f86a169-7d06-46d9-9c07-8845116e099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f86a169-7d06-46d9-9c07-8845116e099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411508022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac1933e-7d16-45b6-9894-f9b72f2b0309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:40Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f02e47-8d8f-4101-999c-4dc94a42254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f02e47-8d8f-4101-999c-4dc94a42254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3568cc0d-958c-4d95-8704-20c58800729d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3568cc0d-958c-4d95-8704-20c58800729d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac1933e-7d16-45b6-9894-f9b72f2b0309', 'volume_name': 'volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01480775-25d8-48b3-8fa8-140cf12001f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01480775-25d8-48b3-8fa8-140cf12001f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b67f17-2721-4a55-a03f-0ac89e7e1283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:40 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume 3ac1933e-7d16-45b6-9894-f9b72f2b0309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309', 'volume_size': 1} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411508022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac1933e-7d16-45b6-9894-f9b72f2b0309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:40Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Creating volume 3ac1933e-7d16-45b6-9894-f9b72f2b0309 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:40 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:40 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 1073741824 Jul 31 07:36:40 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:40 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 1073741824" returned: 0 in 0.500s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:40 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 Jul 31 07:36:40 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:41 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309" returned: 0 in 0.268s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b67f17-2721-4a55-a03f-0ac89e7e1283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea90ea8e-65af-431c-abed-8c649e761544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:41 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 (3ac1933e-7d16-45b6-9894-f9b72f2b0309): created successfully Jul 31 07:36:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea90ea8e-65af-431c-abed-8c649e761544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (81b2fc3d-99bb-4110-b69c-26837477a93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:41 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4dd1e9ac-de04-4287-9e9f-904652598c6b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created volume successfully. Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (58340dde-44eb-41a6-95db-5034fca9b844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebbd27d-c8af-4c82-a56a-481378bbc75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebbd27d-c8af-4c82-a56a-481378bbc75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-807261663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:43Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad674209-5c90-4933-91f8-0cbf3da500b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad674209-5c90-4933-91f8-0cbf3da500b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc85e07-dc58-4e5b-926a-1e65db830def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc85e07-dc58-4e5b-926a-1e65db830def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e', 'volume_name': 'volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27f7d61-1bc0-4caf-9681-d9a7cee83f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27f7d61-1bc0-4caf-9681-d9a7cee83f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c978e1-9668-4166-90b5-effc616101b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:42 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume 8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e', 'volume_size': 1} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-807261663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:43Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Creating volume 8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:42 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:42 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e 1073741824 Jul 31 07:36:42 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (2d2194f7-16b4-424e-b740-b9aa046cd2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed229995-769f-4bdd-929c-090b68040f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed229995-769f-4bdd-929c-090b68040f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208636661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb3e097-c4ca-46ef-9458-9ecc356a906e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:43Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:43 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11f5f03-0125-491c-9554-a78ad6f59cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11f5f03-0125-491c-9554-a78ad6f59cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b15af7-6124-46dd-91cf-5166bc2a9fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b15af7-6124-46dd-91cf-5166bc2a9fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb3e097-c4ca-46ef-9458-9ecc356a906e', 'volume_name': 'volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e3c124-cd48-4104-92cf-906bc02a4a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e3c124-cd48-4104-92cf-906bc02a4a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d6b80b-d154-4551-94a3-03c800820d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:43 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume fcb3e097-c4ca-46ef-9458-9ecc356a906e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e', 'volume_size': 1} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e 1073741824" returned: 0 in 0.711s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:43 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e Jul 31 07:36:43 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:44 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e" returned: 0 in 0.387s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208636661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb3e097-c4ca-46ef-9458-9ecc356a906e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:43Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Creating volume fcb3e097-c4ca-46ef-9458-9ecc356a906e {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:44 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c978e1-9668-4166-90b5-effc616101b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e 1073741824 Jul 31 07:36:44 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af712337-8823-4d29-ae38-ef7053d8816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (24123f6e-47f9-419e-901d-94d31cc6d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8936d97d-0b22-4144-9ea2-b8ca6614b8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e (8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e): created successfully Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af712337-8823-4d29-ae38-ef7053d8816a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (58340dde-44eb-41a6-95db-5034fca9b844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c31ec5b3-147b-435d-b57f-e216e06408ab tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created volume successfully. Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8936d97d-0b22-4144-9ea2-b8ca6614b8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-628113172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30845935-0eb2-4e92-9aca-0506d04fd08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:44Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23eeac1-ebf8-4f59-aad0-4940aaa1694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23eeac1-ebf8-4f59-aad0-4940aaa1694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72bb507-20f5-4803-b5b3-788117327c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72bb507-20f5-4803-b5b3-788117327c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30845935-0eb2-4e92-9aca-0506d04fd08c', 'volume_name': 'volume-30845935-0eb2-4e92-9aca-0506d04fd08c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc07b48-4232-4ad6-9ea5-34018af13c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc07b48-4232-4ad6-9ea5-34018af13c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61529a95-ad9a-4f6c-8dbb-dcd15a901966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume 30845935-0eb2-4e92-9aca-0506d04fd08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30845935-0eb2-4e92-9aca-0506d04fd08c', 'volume_size': 1} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (777fd654-9018-4188-a332-b2d68c71156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7756612d-d964-4559-baa6-875d57c43dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7756612d-d964-4559-baa6-875d57c43dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918390907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1719581c-79f8-47ab-9630-9071c2ffead3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:45Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6a8cdb-e720-48c1-889c-27fd04e36a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6a8cdb-e720-48c1-889c-27fd04e36a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a69e36-80fc-47d6-b95f-33b270f37e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a69e36-80fc-47d6-b95f-33b270f37e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1719581c-79f8-47ab-9630-9071c2ffead3', 'volume_name': 'volume-1719581c-79f8-47ab-9630-9071c2ffead3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0c4910-24b3-4d71-81dd-559e3b2de326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0c4910-24b3-4d71-81dd-559e3b2de326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222f4379-1ff6-4f32-b4cc-05066f326fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume 1719581c-79f8-47ab-9630-9071c2ffead3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1719581c-79f8-47ab-9630-9071c2ffead3', 'volume_size': 1} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e 1073741824" returned: 0 in 0.760s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:44 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e Jul 31 07:36:44 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (95dff60d-4f54-4cf8-94d5-ac287689d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026b847f-67a8-46f5-9b11-bab931e6fba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:45 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e" returned: 0 in 0.370s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-628113172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30845935-0eb2-4e92-9aca-0506d04fd08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:44Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Creating volume 30845935-0eb2-4e92-9aca-0506d04fd08c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:45 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026b847f-67a8-46f5-9b11-bab931e6fba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14158061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c855861c-08d2-42d2-bb27-2b1001489d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:45Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:45 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c 1073741824 Jul 31 07:36:45 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13438e84-a017-451f-8fb3-e60aca82d372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13438e84-a017-451f-8fb3-e60aca82d372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e8792f-504b-43f2-af4c-44935d434687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e8792f-504b-43f2-af4c-44935d434687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c855861c-08d2-42d2-bb27-2b1001489d8c', 'volume_name': 'volume-c855861c-08d2-42d2-bb27-2b1001489d8c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a5df6e-70f0-48f2-82ba-8ab7265d7c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a5df6e-70f0-48f2-82ba-8ab7265d7c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa10a80d-1238-4060-847d-a3e02b3a256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume c855861c-08d2-42d2-bb27-2b1001489d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c855861c-08d2-42d2-bb27-2b1001489d8c', 'volume_size': 1} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d6b80b-d154-4551-94a3-03c800820d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3022c83-dff9-49c7-be22-a5c02967716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e (fcb3e097-c4ca-46ef-9458-9ecc356a906e): created successfully Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3022c83-dff9-49c7-be22-a5c02967716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (2d2194f7-16b4-424e-b740-b9aa046cd2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fe2e49ba-f974-462e-af37-186a0b744b5e tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created volume successfully. Jul 31 07:36:45 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c 1073741824" returned: 0 in 0.532s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:45 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c Jul 31 07:36:45 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:46 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918390907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1719581c-79f8-47ab-9630-9071c2ffead3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:45Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Creating volume 1719581c-79f8-47ab-9630-9071c2ffead3 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:46 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61529a95-ad9a-4f6c-8dbb-dcd15a901966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30845935-0eb2-4e92-9aca-0506d04fd08c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c203f40d-1417-4a60-8811-257bc773427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:46 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 1073741824 Jul 31 07:36:46 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume volume-30845935-0eb2-4e92-9aca-0506d04fd08c (30845935-0eb2-4e92-9aca-0506d04fd08c): created successfully Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c203f40d-1417-4a60-8811-257bc773427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (24123f6e-47f9-419e-901d-94d31cc6d935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-dca49039-599b-4939-8b56-04ad1d1c0481 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created volume successfully. Jul 31 07:36:46 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 1073741824" returned: 0 in 0.484s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:46 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 Jul 31 07:36:46 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:46 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3" returned: 0 in 0.244s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14158061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c855861c-08d2-42d2-bb27-2b1001489d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f290eec3f7c4847bc2c21a57e7ea2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:36:45Z,use_quota=True,user_id='5b51ef6aab144304a2c0d6456463cf90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Creating volume c855861c-08d2-42d2-bb27-2b1001489d8c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:36:46 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222f4379-1ff6-4f32-b4cc-05066f326fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1719581c-79f8-47ab-9630-9071c2ffead3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:46 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c 1073741824 Jul 31 07:36:46 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8165feb-aacc-42e6-b524-6c09a917c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:47 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume volume-1719581c-79f8-47ab-9630-9071c2ffead3 (1719581c-79f8-47ab-9630-9071c2ffead3): created successfully Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8165feb-aacc-42e6-b524-6c09a917c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (777fd654-9018-4188-a332-b2d68c71156b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-04a19e5a-5b2e-461b-b115-150ff0389742 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created volume successfully. Jul 31 07:36:47 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c 1073741824" returned: 0 in 0.487s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:47 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c Jul 31 07:36:47 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:47 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa10a80d-1238-4060-847d-a3e02b3a256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c855861c-08d2-42d2-bb27-2b1001489d8c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2b2f22-6596-434c-9334-5e2c5b02c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:36:47 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Volume volume-c855861c-08d2-42d2-bb27-2b1001489d8c (c855861c-08d2-42d2-bb27-2b1001489d8c): created successfully Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2b2f22-6596-434c-9334-5e2c5b02c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:36:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Flow 'volume_create_manager' (95dff60d-4f54-4cf8-94d5-ac287689d59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:36:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-699a7005-a4fb-4c0c-9c8f-ab7bdb437b7f tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created volume successfully. Jul 31 07:36:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-c855861c-08d2-42d2-bb27-2b1001489d8c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-c855861c-08d2-42d2-bb27-2b1001489d8c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-quobyte-c855861c-08d2-42d2-bb27-2b1001489d8c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-c855861c-08d2-42d2-bb27-2b1001489d8c" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:48 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7f86f-d045-4f4f-b0d0-0c1875831130]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:48 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c Jul 31 07:36:48 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:49 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c" returned: 0 in 0.387s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:49 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c Jul 31 07:36:49 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:49 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c855861c-08d2-42d2-bb27-2b1001489d8c" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-c855861c-08d2-42d2-bb27-2b1001489d8c" released by "delete_volume" :: held 0.694s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created reservations ['37c68bcf-905c-4cbb-98a4-13ce993f7961', 'f333d62c-b41b-40f8-b013-886101f0c90a', 'bf71fb6e-26c3-49e1-a836-4a9ee32097c8', 'e2bdaefe-8a2d-4fdd-b0ee-c1c4c8509dc9'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:49 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:49 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-1719581c-79f8-47ab-9630-9071c2ffead3-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:49 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.290s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-1719581c-79f8-47ab-9630-9071c2ffead3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:49 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Deleted volume successfully. Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3a8de80b-10bd-4d10-a73a-54215f3d515b tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-c855861c-08d2-42d2-bb27-2b1001489d8c-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-quobyte-1719581c-79f8-47ab-9630-9071c2ffead3" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-1719581c-79f8-47ab-9630-9071c2ffead3" acquired by "delete_volume" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd64603-9147-4eb4-817e-7ebb1e311999]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:49 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 Jul 31 07:36:49 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:50 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3" returned: 0 in 0.379s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:50 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3 Jul 31 07:36:50 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:50 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1719581c-79f8-47ab-9630-9071c2ffead3" returned: 0 in 0.250s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-1719581c-79f8-47ab-9630-9071c2ffead3" released by "delete_volume" :: held 0.698s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created reservations ['182e7973-bb83-47a4-bad4-eead4b47caa2', '23383cec-90a2-4657-a36d-331ea23fe475', 'f41e572e-a6a4-44df-a23c-3aec3d3a4070', '0cc4e52c-71cf-4227-8c84-077d1d11b55b'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:50 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:50 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:50 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Deleted volume successfully. Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-30845935-0eb2-4e92-9aca-0506d04fd08c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ba673e40-dbaf-46ec-a228-7b399c6fe963 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-1719581c-79f8-47ab-9630-9071c2ffead3-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-30845935-0eb2-4e92-9aca-0506d04fd08c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-quobyte-30845935-0eb2-4e92-9aca-0506d04fd08c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-30845935-0eb2-4e92-9aca-0506d04fd08c" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc42c31-43b7-4433-a017-2cf841ce4c3f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:51 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c Jul 31 07:36:51 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:51 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c" returned: 0 in 0.354s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:51 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c Jul 31 07:36:51 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:51 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30845935-0eb2-4e92-9aca-0506d04fd08c" returned: 0 in 0.234s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-30845935-0eb2-4e92-9aca-0506d04fd08c" released by "delete_volume" :: held 0.625s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created reservations ['eb56cd8c-05de-461a-b498-4ce5385b1ce2', '177acbb5-a550-4354-a3d2-12b22eb6016a', '991d22ee-9a38-472f-8564-81700918d40a', '6571d2e1-1fc3-4cf7-8755-895739e360f1'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:51 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:51 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:51 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Deleted volume successfully. Jul 31 07:36:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9557ba89-d8b4-44ad-87de-e3a74152d021 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-30845935-0eb2-4e92-9aca-0506d04fd08c-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-fcb3e097-c4ca-46ef-9458-9ecc356a906e-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-fcb3e097-c4ca-46ef-9458-9ecc356a906e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-quobyte-fcb3e097-c4ca-46ef-9458-9ecc356a906e" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-fcb3e097-c4ca-46ef-9458-9ecc356a906e" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb79bfb-cfe7-4044-a665-47da0bd8f5af]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:52 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e Jul 31 07:36:52 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:52 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e" returned: 0 in 0.362s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:52 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e Jul 31 07:36:52 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:52 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-fcb3e097-c4ca-46ef-9458-9ecc356a906e" returned: 0 in 0.257s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-fcb3e097-c4ca-46ef-9458-9ecc356a906e" released by "delete_volume" :: held 0.657s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created reservations ['77e297b6-de41-47dd-b94a-5ae1b84ba8eb', '91470447-2036-41dc-94f3-c2402882a7d7', 'f6fc348f-162b-4a4c-aec8-d67a7b9db3c0', '57b996a9-cc44-4fea-b5c2-be81427598fb'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:52 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:52 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:53 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Deleted volume successfully. Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7222efba-a40e-4619-908d-2b429c17297d tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-fcb3e097-c4ca-46ef-9458-9ecc356a906e-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-quobyte-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfda6ab-8e25-4025-b6de-235249798129]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:53 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e Jul 31 07:36:53 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:53 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e" returned: 0 in 0.363s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:53 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e Jul 31 07:36:53 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:53 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e" returned: 0 in 0.258s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e" released by "delete_volume" :: held 0.678s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created reservations ['8fc21176-6ca6-4efb-9821-5a859570995a', '7b95e454-21c6-4444-a415-49d61776d8b2', 'a1200eff-d5d0-48f4-a888-da40011720b0', '52051068-b44e-424f-bbd3-093c53cd62b7'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:54 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:54 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:54 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Deleted volume successfully. Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-16964931-2885-4de7-b9d3-f16927567533 tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-8cfee4d6-0c4a-435b-afc9-0ab9ae0dca4e-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-3ac1933e-7d16-45b6-9894-f9b72f2b0309-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-3ac1933e-7d16-45b6-9894-f9b72f2b0309-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "cinder-quobyte-3ac1933e-7d16-45b6-9894-f9b72f2b0309" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-3ac1933e-7d16-45b6-9894-f9b72f2b0309" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce985862-ef16-4e6d-a0e2-b992f19eb31d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:54 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 Jul 31 07:36:54 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:54 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309" returned: 0 in 0.391s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:54 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309 Jul 31 07:36:54 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:55 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3ac1933e-7d16-45b6-9894-f9b72f2b0309" returned: 0 in 0.276s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-quobyte-3ac1933e-7d16-45b6-9894-f9b72f2b0309" released by "delete_volume" :: held 0.707s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Created reservations ['77e9e09a-cb4b-4595-ba24-9cf8da751157', 'b2f1a03a-01f8-4f04-a29c-6443fdfb0b9f', '8af48801-637d-45f2-a0ec-cc33aaaf053c', '84193529-8616-4c86-bfc9-e54c45bace7d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:36:55 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:36:55 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:36:55 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.250s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:36:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Deleted volume successfully. Jul 31 07:36:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-68da00de-85e5-470a-ae48-b9d4069a7e8c tempest-CreateVolumesFromSourceVolumeTest-2009246607 None] Lock "cinder-3ac1933e-7d16-45b6-9894-f9b72f2b0309-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:37:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-4f4706ae-3aa5-4b59-b04f-3a1f1b304655 req-13b0152e-361d-4740-987f-caa7806b46e1 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-4f4706ae-3aa5-4b59-b04f-3a1f1b304655 req-13b0152e-361d-4740-987f-caa7806b46e1 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-4f4706ae-3aa5-4b59-b04f-3a1f1b304655 req-13b0152e-361d-4740-987f-caa7806b46e1 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:00 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-4f4706ae-3aa5-4b59-b04f-3a1f1b304655 req-13b0152e-361d-4740-987f-caa7806b46e1 tempest-TestInstancesWithCinderVolumes-538694990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7f3e69a-2cf8-45d0-894e-e72a2b88e6d9', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:37:00 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-4f4706ae-3aa5-4b59-b04f-3a1f1b304655 req-13b0152e-361d-4740-987f-caa7806b46e1 tempest-TestInstancesWithCinderVolumes-538694990 None] attachment_update completed successfully. Jul 31 07:37:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-0d46ac85-b2ca-4f68-837e-8285fe96212b req-a249e86d-e80d-42ad-8c65-734a13966826 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-0d46ac85-b2ca-4f68-837e-8285fe96212b req-a249e86d-e80d-42ad-8c65-734a13966826 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-0d46ac85-b2ca-4f68-837e-8285fe96212b req-a249e86d-e80d-42ad-8c65-734a13966826 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:02 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-0d46ac85-b2ca-4f68-837e-8285fe96212b req-a249e86d-e80d-42ad-8c65-734a13966826 tempest-TestInstancesWithCinderVolumes-538694990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '545f2061-b5b8-496f-b522-6c6255df5fa1', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:37:02 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-0d46ac85-b2ca-4f68-837e-8285fe96212b req-a249e86d-e80d-42ad-8c65-734a13966826 tempest-TestInstancesWithCinderVolumes-538694990 None] attachment_update completed successfully. Jul 31 07:37:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-c39ee4f3-554c-4f52-afe8-bbc738837385 req-f4c4dc33-c783-498e-bfb2-9a3082300e2f tempest-TestInstancesWithCinderVolumes-538694990 None] Terminate volume connection completed successfully. Jul 31 07:37:06 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-c39ee4f3-554c-4f52-afe8-bbc738837385 req-f4c4dc33-c783-498e-bfb2-9a3082300e2f tempest-TestInstancesWithCinderVolumes-538694990 None] Deleting attachment a7f3e69a-2cf8-45d0-894e-e72a2b88e6d9. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "cinder-aab4d5ed-9d23-4155-bf50-79ebb00db18d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-aab4d5ed-9d23-4155-bf50-79ebb00db18d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "cinder-quobyte-aab4d5ed-9d23-4155-bf50-79ebb00db18d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-quobyte-aab4d5ed-9d23-4155-bf50-79ebb00db18d" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ddd09-036e-4196-8216-9df9c082dbcb]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:07 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d Jul 31 07:37:07 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:07 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d" returned: 0 in 0.390s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:07 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d Jul 31 07:37:07 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:08 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-aab4d5ed-9d23-4155-bf50-79ebb00db18d" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-quobyte-aab4d5ed-9d23-4155-bf50-79ebb00db18d" released by "delete_volume" :: held 0.706s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:37:08 devstack cinder-volume[88915]: WARNING cinder.quota [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254068980-1547728418 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254068980-1547728418, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:37:08 devstack cinder-volume[88915]: WARNING cinder.quota [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254068980-1547728418 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254068980-1547728418, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Created reservations ['2f325f4f-d1e8-48e5-b6f1-6d6b58c3dff4', 'a7e55085-43d0-4f07-9661-4f90efc9f565', 'f3a20836-26ba-495e-acbf-a459af238ceb', '62a39f56-140b-4458-bb9f-abc366268f22'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:08 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:37:08 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:08 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.251s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:37:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Deleted volume successfully. Jul 31 07:37:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a977ded3-042c-46c4-b45e-bb6250465133 tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-aab4d5ed-9d23-4155-bf50-79ebb00db18d-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:37:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-28d1baf3-2018-40d5-b879-9ee784b0d5ed req-7abf6f0b-e9c5-4cff-b441-c69a3d212f9b tempest-TestInstancesWithCinderVolumes-538694990 None] Terminate volume connection completed successfully. Jul 31 07:37:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-28d1baf3-2018-40d5-b879-9ee784b0d5ed req-7abf6f0b-e9c5-4cff-b441-c69a3d212f9b tempest-TestInstancesWithCinderVolumes-538694990 None] Deleting attachment 545f2061-b5b8-496f-b522-6c6255df5fa1. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "cinder-f4d9add6-2fbf-4153-a30b-36d26d1ab019-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-f4d9add6-2fbf-4153-a30b-36d26d1ab019-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "cinder-quobyte-f4d9add6-2fbf-4153-a30b-36d26d1ab019" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-quobyte-f4d9add6-2fbf-4153-a30b-36d26d1ab019" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d527b84-2b5c-4743-838e-6299ec52449d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:11 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 Jul 31 07:37:11 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:11 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019" returned: 0 in 0.377s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:11 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019 Jul 31 07:37:11 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:12 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f4d9add6-2fbf-4153-a30b-36d26d1ab019" returned: 0 in 0.250s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-quobyte-f4d9add6-2fbf-4153-a30b-36d26d1ab019" released by "delete_volume" :: held 0.673s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:37:12 devstack cinder-volume[88915]: WARNING cinder.quota [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549522596-1850448731 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549522596-1850448731, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:37:12 devstack cinder-volume[88915]: WARNING cinder.quota [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549522596-1850448731 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549522596-1850448731, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Created reservations ['f9c3a256-d7e0-4ba0-9a07-8ee506f90298', 'ff2ddf17-09e4-4fa8-bed6-0452d70382f2', 'c93e55c8-05f9-418e-8d06-18b8ad3ef0d0', 'abe4b3ae-bcad-4bc9-a0fc-939c712b206c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:12 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:37:12 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:12 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.280s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:37:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Deleted volume successfully. Jul 31 07:37:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1af6a890-280f-43e9-b09f-7238a4df94ad tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-f4d9add6-2fbf-4153-a30b-36d26d1ab019-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:37:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-11ea64f2-8e69-416e-843d-11bb6661ae87 req-33910763-c7f3-418a-b6f9-2e94df8dde0a tempest-TestInstancesWithCinderVolumes-538694990 None] Terminate volume connection completed successfully. Jul 31 07:37:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-11ea64f2-8e69-416e-843d-11bb6661ae87 req-33910763-c7f3-418a-b6f9-2e94df8dde0a tempest-TestInstancesWithCinderVolumes-538694990 None] Deleting attachment d9263e7a-2b37-4573-b80f-9c43893b4935. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "cinder-df376e9d-3d3f-4dc2-b502-1331fb6b81b2-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-df376e9d-3d3f-4dc2-b502-1331fb6b81b2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "cinder-quobyte-df376e9d-3d3f-4dc2-b502-1331fb6b81b2" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-quobyte-df376e9d-3d3f-4dc2-b502-1331fb6b81b2" acquired by "delete_volume" :: waited 0.013s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688fa05-58b6-480e-8d63-de7123b7b6e0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:16 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 Jul 31 07:37:16 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:16 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2" returned: 0 in 0.344s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:16 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2 Jul 31 07:37:16 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:16 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-df376e9d-3d3f-4dc2-b502-1331fb6b81b2" returned: 0 in 0.235s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-quobyte-df376e9d-3d3f-4dc2-b502-1331fb6b81b2" released by "delete_volume" :: held 0.619s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:37:16 devstack cinder-volume[88915]: WARNING cinder.quota [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961804126-1129031118 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961804126-1129031118, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:37:16 devstack cinder-volume[88915]: WARNING cinder.quota [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961804126-1129031118 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961804126-1129031118, it is now deprecated. Please use the default quota class for default quota. Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Created reservations ['a521869a-ad2d-49ab-a0b6-79b306932f0a', 'c17510d0-d966-4eaa-9b21-8baf81bbca24', '846b182b-e794-4ac1-bf98-f499d5433a04', 'a167c06c-4da0-41bd-b01a-7bbfdf803c7e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:17 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:37:17 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:17 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.232s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:17 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:37:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Deleted volume successfully. Jul 31 07:37:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b7c6a9e4-8cfe-4fc4-8355-4993c90a69ba tempest-TestInstancesWithCinderVolumes-538694990 None] Lock "cinder-df376e9d-3d3f-4dc2-b502-1331fb6b81b2-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:37:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:DELETE=10,cinder:SELECT=96,cinder:UPDATE=113,cinder:INSERT=36 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:37:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=132,cinder:SELECT=94,cinder:INSERT=28,cinder:DELETE=11 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:33 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:37:33 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:33 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.259s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:37:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Flow 'volume_create_manager' (a62a7fb3-d30e-4d98-986c-442e760d0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fe1527-af0e-46f4-b1fc-a27f238f38a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fe1527-af0e-46f4-b1fc-a27f238f38a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1703283173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b3cdb5-ae51-4823-bb7b-44d64b6985b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024e051f6a794ccda6aee6289fa19b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:37:54Z,use_quota=True,user_id='0157fab70c694a248f3533f914f7cc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63d2af6-113c-4ad7-a6ad-a1ab1db29144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63d2af6-113c-4ad7-a6ad-a1ab1db29144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c993d7-d7cb-4afd-8855-df84984d209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c993d7-d7cb-4afd-8855-df84984d209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b3cdb5-ae51-4823-bb7b-44d64b6985b8', 'volume_name': 'volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09393073-80f0-4e23-82fe-c93668c870fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09393073-80f0-4e23-82fe-c93668c870fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0441e464-96ff-4595-90d1-553ec424df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:37:53 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Volume d1b3cdb5-ae51-4823-bb7b-44d64b6985b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8', 'volume_size': 1} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1703283173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b3cdb5-ae51-4823-bb7b-44d64b6985b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024e051f6a794ccda6aee6289fa19b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:37:54Z,use_quota=True,user_id='0157fab70c694a248f3533f914f7cc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Creating volume d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:37:53 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:37:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:53 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 1073741824 Jul 31 07:37:53 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:54 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 1073741824" returned: 0 in 0.436s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:37:54 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 Jul 31 07:37:54 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:37:54 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0441e464-96ff-4595-90d1-553ec424df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a20463-5d54-4f65-bba3-d9f4d6510f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:37:54 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Volume volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 (d1b3cdb5-ae51-4823-bb7b-44d64b6985b8): created successfully Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a20463-5d54-4f65-bba3-d9f4d6510f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:37:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Flow 'volume_create_manager' (a62a7fb3-d30e-4d98-986c-442e760d0540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:37:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8519ea16-6b05-44c9-84a7-3b4c9dcec0e6 tempest-TestMinimumBasicScenario-1364770722 None] Created volume successfully. Jul 31 07:37:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-44800a45-33c3-4444-871b-eddf972d3b57 req-a083926b-6ced-4290-8159-46476a849241 tempest-TestMinimumBasicScenario-1364770722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:37:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-44800a45-33c3-4444-871b-eddf972d3b57 req-a083926b-6ced-4290-8159-46476a849241 tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:37:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-44800a45-33c3-4444-871b-eddf972d3b57 req-a083926b-6ced-4290-8159-46476a849241 tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:37:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-44800a45-33c3-4444-871b-eddf972d3b57 req-a083926b-6ced-4290-8159-46476a849241 tempest-TestMinimumBasicScenario-1364770722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6825eb66-e134-4848-a526-2d201d08e315', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:37:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-44800a45-33c3-4444-871b-eddf972d3b57 req-a083926b-6ced-4290-8159-46476a849241 tempest-TestMinimumBasicScenario-1364770722 None] attachment_update completed successfully. Jul 31 07:38:05 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:38:05 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=5,cinder:SELECT=8,cinder:DELETE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:38:33 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:38:33 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:38:33 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.233s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:38:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:38:41 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-b137f980-689a-4172-80df-177d57ff53b4 req-de425d8e-a868-49e7-9e03-5ef9cf51b9c5 tempest-TestMinimumBasicScenario-1364770722 None] Terminate volume connection completed successfully. Jul 31 07:38:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-b137f980-689a-4172-80df-177d57ff53b4 req-de425d8e-a868-49e7-9e03-5ef9cf51b9c5 tempest-TestMinimumBasicScenario-1364770722 None] Deleting attachment 6825eb66-e134-4848-a526-2d201d08e315. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Acquiring lock "cinder-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Lock "cinder-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Acquiring lock "cinder-quobyte-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Lock "cinder-quobyte-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61d6770-3642-4c88-93a3-692a95be9357]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:38:42 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 Jul 31 07:38:42 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:38:42 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8" returned: 0 in 0.357s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:38:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:38:42 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8 Jul 31 07:38:42 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:38:43 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8" returned: 0 in 0.240s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Lock "cinder-quobyte-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8" released by "delete_volume" :: held 0.635s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Created reservations ['a1c1bd26-34e1-4ee4-9c34-2b2bca1c9f12', '469ab726-707f-4570-a43e-cb9a344dc900', 'd49c3887-6fca-4215-8168-b8175dc5d0a2', 'c8c17af4-37bc-46ac-ba90-fde9405f3668'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:38:43 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:38:43 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:38:43 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.254s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:38:43 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Deleted volume successfully. Jul 31 07:38:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-77e4a289-d53e-4339-8996-487dc01d83ef tempest-TestMinimumBasicScenario-1364770722 None] Lock "cinder-d1b3cdb5-ae51-4823-bb7b-44d64b6985b8-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:38:53 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:38:53 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Flow 'volume_create_manager' (90b59bab-f2be-4fd0-9521-292de7a94607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5152eb31-4f35-4786-a76a-a5ae80b16992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5152eb31-4f35-4786-a76a-a5ae80b16992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-520194488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30df102d-b77c-44c6-a208-68b5eeb139f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8daab7ce64d35a4888e33f18be0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:39:14Z,use_quota=True,user_id='695ac52d643c4877a34ad05b13682bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bab8162-d3d5-458e-a4ce-fcf8b019817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bab8162-d3d5-458e-a4ce-fcf8b019817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874c1fe0-c0e4-418a-a2cc-0dc84e29684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874c1fe0-c0e4-418a-a2cc-0dc84e29684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30df102d-b77c-44c6-a208-68b5eeb139f3', 'volume_name': 'volume-30df102d-b77c-44c6-a208-68b5eeb139f3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f6dfd-1ae2-47d6-a676-486abc6cd0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f6dfd-1ae2-47d6-a676-486abc6cd0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c4e211-a2ac-40b0-ada4-9b5825e1bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:13 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Volume 30df102d-b77c-44c6-a208-68b5eeb139f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30df102d-b77c-44c6-a208-68b5eeb139f3', 'volume_size': 1} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-520194488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30df102d-b77c-44c6-a208-68b5eeb139f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8daab7ce64d35a4888e33f18be0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:39:14Z,use_quota=True,user_id='695ac52d643c4877a34ad05b13682bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Creating volume 30df102d-b77c-44c6-a208-68b5eeb139f3 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:39:13 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:39:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:13 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 1073741824 Jul 31 07:39:13 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Flow 'volume_create_manager' (11f77c1f-cb59-4176-bfd1-1a66ad043a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5f3218-6967-4ee2-af87-150a94b0453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5f3218-6967-4ee2-af87-150a94b0453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-322309589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8daab7ce64d35a4888e33f18be0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:39:14Z,use_quota=True,user_id='695ac52d643c4877a34ad05b13682bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf209e3-5950-478c-8153-50b806acd648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf209e3-5950-478c-8153-50b806acd648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3880b5c-427f-4a24-bb3e-66a523e163ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3880b5c-427f-4a24-bb3e-66a523e163ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90', 'volume_name': 'volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48126c96-006c-4e95-a2c3-73e8f489906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48126c96-006c-4e95-a2c3-73e8f489906f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30d48dc-cf29-4dae-94fd-490785d255a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Volume b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90', 'volume_size': 1} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:14 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 1073741824" returned: 0 in 0.485s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:14 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 Jul 31 07:39:14 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:14 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-322309589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8daab7ce64d35a4888e33f18be0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:39:14Z,use_quota=True,user_id='695ac52d643c4877a34ad05b13682bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Creating volume b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:39:14 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c4e211-a2ac-40b0-ada4-9b5825e1bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30df102d-b77c-44c6-a208-68b5eeb139f3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:14 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 1073741824 Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d22f5b-3ac4-4b69-b55e-b80d94a4a929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:14 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Volume volume-30df102d-b77c-44c6-a208-68b5eeb139f3 (30df102d-b77c-44c6-a208-68b5eeb139f3): created successfully Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d22f5b-3ac4-4b69-b55e-b80d94a4a929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Flow 'volume_create_manager' (90b59bab-f2be-4fd0-9521-292de7a94607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:39:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5675ce17-b0f4-431d-a699-87b2cbcbc9e6 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Created volume successfully. Jul 31 07:39:15 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 1073741824" returned: 0 in 0.506s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:15 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 Jul 31 07:39:15 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:15 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90" returned: 0 in 0.246s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30d48dc-cf29-4dae-94fd-490785d255a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70e9bda-bbdd-4ddd-be41-dd6cb4c0d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:39:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Volume volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 (b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90): created successfully Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70e9bda-bbdd-4ddd-be41-dd6cb4c0d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:39:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Flow 'volume_create_manager' (11f77c1f-cb59-4176-bfd1-1a66ad043a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:39:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-481b6919-6e3e-4992-9c4b-3e54cebc62b9 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Created volume successfully. Jul 31 07:39:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=2 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:39:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:33 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:39:33 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:33 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.254s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:39:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:39:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-50d8ada1-a965-42a3-9948-93eaef481caf req-d77fd1cc-70d3-41d2-9b02-124a7a2a5e64 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-50d8ada1-a965-42a3-9948-93eaef481caf req-d77fd1cc-70d3-41d2-9b02-124a7a2a5e64 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-50d8ada1-a965-42a3-9948-93eaef481caf req-d77fd1cc-70d3-41d2-9b02-124a7a2a5e64 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-50d8ada1-a965-42a3-9948-93eaef481caf req-d77fd1cc-70d3-41d2-9b02-124a7a2a5e64 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-30df102d-b77c-44c6-a208-68b5eeb139f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '248e0afc-4691-4267-94dd-0cf2db0da897', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:39:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-50d8ada1-a965-42a3-9948-93eaef481caf req-d77fd1cc-70d3-41d2-9b02-124a7a2a5e64 tempest-TestServerVolumeAttachmentScenario-1585271155 None] attachment_update completed successfully. Jul 31 07:39:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-fec67296-f3f9-4227-9381-316b0c8c220c req-9ac3299a-8cfa-4a5f-861a-4eb87198e4e1 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-fec67296-f3f9-4227-9381-316b0c8c220c req-9ac3299a-8cfa-4a5f-861a-4eb87198e4e1 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [req-fec67296-f3f9-4227-9381-316b0c8c220c req-9ac3299a-8cfa-4a5f-861a-4eb87198e4e1 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-fec67296-f3f9-4227-9381-316b0c8c220c req-9ac3299a-8cfa-4a5f-861a-4eb87198e4e1 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80', 'name': 'volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62adb47e-d17f-45a4-8be7-42a5cffb65f1', 'enforce_multipath': True} {{(pid=88915) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 07:39:49 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-fec67296-f3f9-4227-9381-316b0c8c220c req-9ac3299a-8cfa-4a5f-861a-4eb87198e4e1 tempest-TestServerVolumeAttachmentScenario-1585271155 None] attachment_update completed successfully. Jul 31 07:39:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-bf705fe4-aa01-4bf4-b154-beb2b36e5e5e req-4bfd1470-7773-4ffb-ad7d-7df19d87b4c8 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Terminate volume connection completed successfully. Jul 31 07:39:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-bf705fe4-aa01-4bf4-b154-beb2b36e5e5e req-4bfd1470-7773-4ffb-ad7d-7df19d87b4c8 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Deleting attachment 62adb47e-d17f-45a4-8be7-42a5cffb65f1. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:39:52 devstack cinder-volume[88915]: INFO cinder.volume.manager [req-89cdbfa6-0ff7-426d-bd69-372c1959809a req-b2c8f2d3-a49b-41a8-8656-6825013255e3 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Terminate volume connection completed successfully. Jul 31 07:39:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [req-89cdbfa6-0ff7-426d-bd69-372c1959809a req-b2c8f2d3-a49b-41a8-8656-6825013255e3 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Deleting attachment 248e0afc-4691-4267-94dd-0cf2db0da897. {{(pid=88915) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 07:39:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "cinder-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:39:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:39:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "cinder-quobyte-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:39:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-quobyte-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90" acquired by "delete_volume" :: waited 0.013s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:39:56 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb889d9f-d332-4f1b-b04f-7f28308ba3e0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:39:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:57 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 Jul 31 07:39:57 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:57 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90" returned: 0 in 0.345s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:57 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90 Jul 31 07:39:57 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:57 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90" returned: 0 in 0.238s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-quobyte-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90" released by "delete_volume" :: held 0.620s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Created reservations ['8f938e6d-1ea7-46f1-912a-a49db491154c', 'e5d7b563-a646-4c08-a150-9187b32408ac', '569804ec-310b-4c8f-bcb7-43eaece40af3', '9bf946b1-c1f1-4d7d-8af5-c2b3dc516e19'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:57 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:39:57 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:57 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.250s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:39:57 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Deleted volume successfully. Jul 31 07:39:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-216617a1-ee74-4341-9e56-27b06d211c42 tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-b3e0f5c4-b231-4adc-9bcb-e1cf7af49d90-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "cinder-30df102d-b77c-44c6-a208-68b5eeb139f3-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-30df102d-b77c-44c6-a208-68b5eeb139f3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "cinder-quobyte-30df102d-b77c-44c6-a208-68b5eeb139f3" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-quobyte-30df102d-b77c-44c6-a208-68b5eeb139f3" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbd6c19-ca93-485e-9b36-cd8a79be8d61]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:58 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 Jul 31 07:39:58 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:58 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3" returned: 0 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:58 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3 Jul 31 07:39:58 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:58 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-30df102d-b77c-44c6-a208-68b5eeb139f3" returned: 0 in 0.237s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-quobyte-30df102d-b77c-44c6-a208-68b5eeb139f3" released by "delete_volume" :: held 0.620s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Created reservations ['20e6619a-6aed-4ca9-b77d-61abbb1f5514', '0cb1f0f2-d630-49f6-80d3-35ac028bbfd5', '23c59fe4-242d-4133-8be8-ef1f39ca7ae9', 'af0340e5-82e7-4349-81bd-6c36a25da78b'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:39:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:39:58 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:39:58 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:39:59 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 31 07:39:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.243s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:39:59 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:39:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Deleted volume successfully. Jul 31 07:39:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-18d13d9f-07f4-41b2-a4c0-a5f55bbd592e tempest-TestServerVolumeAttachmentScenario-1585271155 None] Lock "cinder-30df102d-b77c-44c6-a208-68b5eeb139f3-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (a5b86e4b-28ec-4065-9062-2bbcf22f1937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a22993-866a-401b-bea4-fef836cbea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a22993-866a-401b-bea4-fef836cbea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724525272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6648a8b1-efbe-41c4-ace1-73e026f62e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:08Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da0adfe-4804-49a4-a0dd-47f6db4bf5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da0adfe-4804-49a4-a0dd-47f6db4bf5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a23a183-18c5-4c23-907b-5c7e9cd9f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a23a183-18c5-4c23-907b-5c7e9cd9f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6648a8b1-efbe-41c4-ace1-73e026f62e73', 'volume_name': 'volume-6648a8b1-efbe-41c4-ace1-73e026f62e73', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cce5cc-2bfb-46fd-80ec-e48a3b32eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cce5cc-2bfb-46fd-80ec-e48a3b32eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c00c899-05e3-4ccf-91d3-a075ddba57c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Volume 6648a8b1-efbe-41c4-ace1-73e026f62e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6648a8b1-efbe-41c4-ace1-73e026f62e73', 'volume_size': 1} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724525272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6648a8b1-efbe-41c4-ace1-73e026f62e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:08Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Creating volume 6648a8b1-efbe-41c4-ace1-73e026f62e73 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:40:08 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:08 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 1073741824 Jul 31 07:40:08 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (aafddbec-c5d3-4823-aa3c-88cdc7ab0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ee56f0-b18d-4408-a400-b6fc111217cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ee56f0-b18d-4408-a400-b6fc111217cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-80118867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd914ca-5697-400a-a6a8-3b03b4b99299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:09Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faaba09-90ec-4f83-b55e-980a6693a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faaba09-90ec-4f83-b55e-980a6693a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5275e58-ddef-45d3-a5e3-8a6ba7b85ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5275e58-ddef-45d3-a5e3-8a6ba7b85ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd914ca-5697-400a-a6a8-3b03b4b99299', 'volume_name': 'volume-0fd914ca-5697-400a-a6a8-3b03b4b99299', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8368d0a5-8e80-4cc3-a3c4-8dda10c9022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8368d0a5-8e80-4cc3-a3c4-8dda10c9022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c4018f-dd4b-4dfd-9d97-483c31c5fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:08 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Volume 0fd914ca-5697-400a-a6a8-3b03b4b99299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd914ca-5697-400a-a6a8-3b03b4b99299', 'volume_size': 1} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:08 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 1073741824" returned: 0 in 0.490s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:08 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 Jul 31 07:40:08 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:08 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (be8240b6-3e31-42f0-9c6b-348d36282791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a5e83f-329a-4ed8-969e-5b6545a07b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a5e83f-329a-4ed8-969e-5b6545a07b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051095822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49ca360-1e34-4943-8979-bc5fdb827c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:09Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304ef53a-8393-4338-874a-d0f0ac07d94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304ef53a-8393-4338-874a-d0f0ac07d94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27a0fc5-31df-4980-87d7-337d3b17649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27a0fc5-31df-4980-87d7-337d3b17649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49ca360-1e34-4943-8979-bc5fdb827c2b', 'volume_name': 'volume-b49ca360-1e34-4943-8979-bc5fdb827c2b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcc24d0-afb5-4baa-bfdf-48bf3f39ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcc24d0-afb5-4baa-bfdf-48bf3f39ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42d1382-df3d-47e4-8911-c5ddf4abe60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Volume b49ca360-1e34-4943-8979-bc5fdb827c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49ca360-1e34-4943-8979-bc5fdb827c2b', 'volume_size': 1} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:09 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73" returned: 0 in 0.288s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-80118867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd914ca-5697-400a-a6a8-3b03b4b99299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:09Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Creating volume 0fd914ca-5697-400a-a6a8-3b03b4b99299 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:40:09 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c00c899-05e3-4ccf-91d3-a075ddba57c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6648a8b1-efbe-41c4-ace1-73e026f62e73', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 1073741824 Jul 31 07:40:09 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bc7295-8f18-4f5f-a86b-196bba526599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Volume volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 (6648a8b1-efbe-41c4-ace1-73e026f62e73): created successfully Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bc7295-8f18-4f5f-a86b-196bba526599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (a5b86e4b-28ec-4065-9062-2bbcf22f1937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-d522be3f-d19f-4a2b-8f97-a22724a3732d tempest-CreateVolumesFromImageTest-532106501 None] Created volume successfully. Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (c87f8f3d-2997-4531-a678-43fc123f04c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a23958-4c9b-4c4e-a87a-d543c4f68b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a23958-4c9b-4c4e-a87a-d543c4f68b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453659658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5061e51-4df6-4fad-ab08-0844232669fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:09Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42faaa63-ea19-431e-b4c9-3faefefe1d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42faaa63-ea19-431e-b4c9-3faefefe1d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048fb0dd-c990-4b4e-a07a-9ed3af308a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048fb0dd-c990-4b4e-a07a-9ed3af308a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5061e51-4df6-4fad-ab08-0844232669fa', 'volume_name': 'volume-d5061e51-4df6-4fad-ab08-0844232669fa', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd851232-323c-41ce-ac80-238f19c553d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd851232-323c-41ce-ac80-238f19c553d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c4b5c5-2728-4157-b604-40732b032cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Volume d5061e51-4df6-4fad-ab08-0844232669fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5061e51-4df6-4fad-ab08-0844232669fa', 'volume_size': 1} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:09 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 1073741824" returned: 0 in 0.474s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (611b0d19-01c5-405a-8cf7-8d53276f2315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f1c7b6-9b5c-41a2-a1e6-feb98d4b087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f1c7b6-9b5c-41a2-a1e6-feb98d4b087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-174298594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8c114a-96c6-46c4-b810-1497cdd56acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:10Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b2cce6-e2ef-4a2b-94b5-16b9b495a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b2cce6-e2ef-4a2b-94b5-16b9b495a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c940845-8471-48a7-a2a9-6fdc3da27477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c940845-8471-48a7-a2a9-6fdc3da27477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8c114a-96c6-46c4-b810-1497cdd56acf', 'volume_name': 'volume-3c8c114a-96c6-46c4-b810-1497cdd56acf', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4850307e-aa8d-4dde-912d-0d87fda942cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4850307e-aa8d-4dde-912d-0d87fda942cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737b35c-27a7-4a45-9c5f-f39ef4f14440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Volume 3c8c114a-96c6-46c4-b810-1497cdd56acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8c114a-96c6-46c4-b810-1497cdd56acf', 'volume_size': 1} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:09 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 Jul 31 07:40:09 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:10 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299" returned: 0 in 0.243s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051095822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49ca360-1e34-4943-8979-bc5fdb827c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:09Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Creating volume b49ca360-1e34-4943-8979-bc5fdb827c2b {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:40:10 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c4018f-dd4b-4dfd-9d97-483c31c5fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd914ca-5697-400a-a6a8-3b03b4b99299', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:10 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b 1073741824 Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab3d344-ceda-4f00-bc66-21cca7c468ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:10 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Volume volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 (0fd914ca-5697-400a-a6a8-3b03b4b99299): created successfully Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab3d344-ceda-4f00-bc66-21cca7c468ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (aafddbec-c5d3-4823-aa3c-88cdc7ab0917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8088afd1-a949-4507-9bb3-6925fca8fe89 tempest-CreateVolumesFromImageTest-532106501 None] Created volume successfully. Jul 31 07:40:10 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b 1073741824" returned: 0 in 0.411s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:10 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b Jul 31 07:40:10 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:10 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b" returned: 0 in 0.244s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453659658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5061e51-4df6-4fad-ab08-0844232669fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:09Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Creating volume d5061e51-4df6-4fad-ab08-0844232669fa {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:40:10 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42d1382-df3d-47e4-8911-c5ddf4abe60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49ca360-1e34-4943-8979-bc5fdb827c2b', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:10 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa 1073741824 Jul 31 07:40:10 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1d386e-a228-45d0-886f-cda5f1594f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Volume volume-b49ca360-1e34-4943-8979-bc5fdb827c2b (b49ca360-1e34-4943-8979-bc5fdb827c2b): created successfully Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1d386e-a228-45d0-886f-cda5f1594f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (be8240b6-3e31-42f0-9c6b-348d36282791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ed8e0c22-a5ac-4c77-bec5-52c383437c4d tempest-CreateVolumesFromImageTest-532106501 None] Created volume successfully. Jul 31 07:40:11 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa 1073741824" returned: 0 in 0.402s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:11 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa Jul 31 07:40:11 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:11 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa" returned: 0 in 0.237s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-174298594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8c114a-96c6-46c4-b810-1497cdd56acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29d8f91ee9e498783afdf8b20d70094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:10Z,use_quota=True,user_id='e9efd075acea426391113f93c706ac18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Creating volume 3c8c114a-96c6-46c4-b810-1497cdd56acf {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:40:11 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c4b5c5-2728-4157-b604-40732b032cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5061e51-4df6-4fad-ab08-0844232669fa', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:11 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf 1073741824 Jul 31 07:40:11 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05651c6f-9c03-4bf3-aacb-5bdb4cddb787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:11 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Volume volume-d5061e51-4df6-4fad-ab08-0844232669fa (d5061e51-4df6-4fad-ab08-0844232669fa): created successfully Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05651c6f-9c03-4bf3-aacb-5bdb4cddb787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (c87f8f3d-2997-4531-a678-43fc123f04c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0b0135e9-a847-4a63-a153-545c483a6248 tempest-CreateVolumesFromImageTest-532106501 None] Created volume successfully. Jul 31 07:40:11 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf 1073741824" returned: 0 in 0.432s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:11 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf Jul 31 07:40:11 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:12 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf" returned: 0 in 0.238s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:40:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737b35c-27a7-4a45-9c5f-f39ef4f14440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8c114a-96c6-46c4-b810-1497cdd56acf', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0684f968-a9e0-4ee9-9bfc-249cc84ca26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:12 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Volume volume-3c8c114a-96c6-46c4-b810-1497cdd56acf (3c8c114a-96c6-46c4-b810-1497cdd56acf): created successfully Jul 31 07:40:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0684f968-a9e0-4ee9-9bfc-249cc84ca26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Flow 'volume_create_manager' (611b0d19-01c5-405a-8cf7-8d53276f2315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-80aa7532-85fd-4bd9-89ff-bad4cd1917cc tempest-CreateVolumesFromImageTest-532106501 None] Created volume successfully. Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-3c8c114a-96c6-46c4-b810-1497cdd56acf-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-3c8c114a-96c6-46c4-b810-1497cdd56acf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-quobyte-3c8c114a-96c6-46c4-b810-1497cdd56acf" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-3c8c114a-96c6-46c4-b810-1497cdd56acf" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d032eb-4bf2-416c-831f-25ea696ae26f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:13 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf Jul 31 07:40:13 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:13 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf" returned: 0 in 0.342s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:13 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf Jul 31 07:40:13 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:13 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3c8c114a-96c6-46c4-b810-1497cdd56acf" returned: 0 in 0.238s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-3c8c114a-96c6-46c4-b810-1497cdd56acf" released by "delete_volume" :: held 0.618s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Created reservations ['26dd1ca3-6d39-40f0-8bb2-f0f196474e26', 'fa752196-b393-4466-b057-22263f43865f', 'e9896beb-38f3-47df-93ef-de1ecfff244b', '2b0bc45d-82de-4945-8ecb-145b00b7852f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:13 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:40:13 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:14 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.237s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:40:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Deleted volume successfully. Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-70251fc1-b1e1-4a72-b203-28c314414981 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-3c8c114a-96c6-46c4-b810-1497cdd56acf-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-d5061e51-4df6-4fad-ab08-0844232669fa-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-d5061e51-4df6-4fad-ab08-0844232669fa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-quobyte-d5061e51-4df6-4fad-ab08-0844232669fa" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-d5061e51-4df6-4fad-ab08-0844232669fa" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4fa513-101c-45b0-b44a-b19388ccfbb2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:14 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa Jul 31 07:40:14 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:14 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa" returned: 0 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:14 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa Jul 31 07:40:14 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:14 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d5061e51-4df6-4fad-ab08-0844232669fa" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-d5061e51-4df6-4fad-ab08-0844232669fa" released by "delete_volume" :: held 0.627s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:14 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Created reservations ['01b9c7ab-e595-44e8-8a7c-c6a585754d4d', '4d31e5dc-c609-463f-afe6-0458ae8ad9d4', '14767a93-138f-477b-86c2-b431940574a9', '89ed6598-ab87-4f87-95cc-6f95401fe023'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:15 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:40:15 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:15 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.234s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:40:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Deleted volume successfully. Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f4eff680-e1b4-4885-a53e-7e5f9d030fea tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-d5061e51-4df6-4fad-ab08-0844232669fa-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-b49ca360-1e34-4943-8979-bc5fdb827c2b-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-b49ca360-1e34-4943-8979-bc5fdb827c2b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-quobyte-b49ca360-1e34-4943-8979-bc5fdb827c2b" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-b49ca360-1e34-4943-8979-bc5fdb827c2b" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b430495-23c3-48ae-91d0-01145aa7ee04]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:15 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b Jul 31 07:40:15 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:15 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b" returned: 0 in 0.351s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:15 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b Jul 31 07:40:15 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:16 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b49ca360-1e34-4943-8979-bc5fdb827c2b" returned: 0 in 0.242s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-b49ca360-1e34-4943-8979-bc5fdb827c2b" released by "delete_volume" :: held 0.630s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Created reservations ['a6d566f8-88b3-4668-b3bf-a3637a014792', 'a1a092ac-ce59-4c3f-b11d-2694f66b4701', '7c53d92b-6e06-4172-b025-71c02c9621c4', 'd13a557d-1e30-4097-b88e-faedf7f2c2e7'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:16 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:40:16 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:16 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.235s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:40:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Deleted volume successfully. Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-734cd9c8-f5d8-4390-9fe7-0f83568ca897 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-b49ca360-1e34-4943-8979-bc5fdb827c2b-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-0fd914ca-5697-400a-a6a8-3b03b4b99299-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-0fd914ca-5697-400a-a6a8-3b03b4b99299-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-quobyte-0fd914ca-5697-400a-a6a8-3b03b4b99299" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-0fd914ca-5697-400a-a6a8-3b03b4b99299" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c423d7a0-3ee2-4cb7-99ce-a66acdc2a0a8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:16 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 Jul 31 07:40:16 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:16 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299" returned: 0 in 0.352s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:17 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299 Jul 31 07:40:17 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:17 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0fd914ca-5697-400a-a6a8-3b03b4b99299" returned: 0 in 0.237s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-0fd914ca-5697-400a-a6a8-3b03b4b99299" released by "delete_volume" :: held 0.629s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Created reservations ['50fca048-a4c1-4672-bbd0-60ba460f45b9', 'b6180171-102f-4e83-9e0c-dababfd58087', '8d38b055-ae78-4e81-8576-e04babb751b1', 'bec177c9-a025-4b1e-9273-92b35518c1e1'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:17 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:40:17 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:17 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.244s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:40:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Deleted volume successfully. Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e2c2092d-e246-4a55-b490-69fde5121778 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-0fd914ca-5697-400a-a6a8-3b03b4b99299-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-6648a8b1-efbe-41c4-ace1-73e026f62e73-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-6648a8b1-efbe-41c4-ace1-73e026f62e73-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "cinder-quobyte-6648a8b1-efbe-41c4-ace1-73e026f62e73" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-6648a8b1-efbe-41c4-ace1-73e026f62e73" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fcad38-dfe5-490a-af61-cc89e955177c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:17 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 Jul 31 07:40:17 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:18 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73" returned: 0 in 0.359s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:18 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73 Jul 31 07:40:18 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:18 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-6648a8b1-efbe-41c4-ace1-73e026f62e73" returned: 0 in 0.248s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-quobyte-6648a8b1-efbe-41c4-ace1-73e026f62e73" released by "delete_volume" :: held 0.645s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Created reservations ['7c7ecbe9-fe04-431d-a1b2-2cf03a04ef73', 'b608ce72-472b-4ead-9be4-2a6176c95b75', 'd111ce67-aa7e-4c39-a71b-119361ecf55b', 'e1539f69-d3aa-4c9d-a827-a17eabfb0944'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:18 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:40:18 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:18 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.233s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:40:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Deleted volume successfully. Jul 31 07:40:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0bb14a99-22c7-4994-95a8-7529bb6b9187 tempest-CreateVolumesFromImageTest-532106501 None] Lock "cinder-6648a8b1-efbe-41c4-ace1-73e026f62e73-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=61,cinder:UPDATE=74,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:40:28 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=59,cinder:UPDATE=74,cinder:INSERT=16,cinder:DELETE=8 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:40:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:40:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:40:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Flow 'volume_create_manager' (a6a7ada0-a5d5-4092-b396-d97d0b94a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fc0c57-3c14-4865-89f1-ff1df8b32d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fc0c57-3c14-4865-89f1-ff1df8b32d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1680879098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d1a179-0142-440c-9a9a-238ac0b5cfec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca5e3d6562149e69103783c2e075bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:42Z,use_quota=True,user_id='19d2997d02294ce09b7c01b91d9e8a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ec8704-699e-44b4-abdb-a78253936e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ec8704-699e-44b4-abdb-a78253936e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0729d1a1-ef67-42d1-ac34-d99c3e3d77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0729d1a1-ef67-42d1-ac34-d99c3e3d77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d1a179-0142-440c-9a9a-238ac0b5cfec', 'volume_name': 'volume-05d1a179-0142-440c-9a9a-238ac0b5cfec', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83341e21-d2a5-4bb9-bd3a-7657acafd6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83341e21-d2a5-4bb9-bd3a-7657acafd6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71121ffd-6a1f-4b9b-b547-5bea3e7e3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:41 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Volume 05d1a179-0142-440c-9a9a-238ac0b5cfec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d1a179-0142-440c-9a9a-238ac0b5cfec', 'volume_size': 1} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1680879098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d1a179-0142-440c-9a9a-238ac0b5cfec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca5e3d6562149e69103783c2e075bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:42Z,use_quota=True,user_id='19d2997d02294ce09b7c01b91d9e8a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Creating volume 05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:40:41 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:40:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:41 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec 1073741824 Jul 31 07:40:41 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:42 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec 1073741824" returned: 0 in 0.408s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:42 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec Jul 31 07:40:42 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:42 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec" returned: 0 in 0.242s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71121ffd-6a1f-4b9b-b547-5bea3e7e3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d1a179-0142-440c-9a9a-238ac0b5cfec', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab6fe0-7a5f-482a-a881-b20eea0977cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:42 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Volume volume-05d1a179-0142-440c-9a9a-238ac0b5cfec (05d1a179-0142-440c-9a9a-238ac0b5cfec): created successfully Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab6fe0-7a5f-482a-a881-b20eea0977cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Flow 'volume_create_manager' (a6a7ada0-a5d5-4092-b396-d97d0b94a821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-edba5d1b-5772-4f5c-b227-ca4a769eb765 tempest-SnapshotDependencyTests-1260198660 None] Created volume successfully. Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Creating offline snapshot 256d79f4-69df-407b-b771-1c403a460e67 of volume 05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[9079dcad-ce79-46ba-8421-9ec4d4f9692c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:43 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec Jul 31 07:40:43 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:43 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec" returned: 0 in 0.343s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:43 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 1G Jul 31 07:40:43 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:43 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 1G" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d1a179-0142-440c-9a9a-238ac0b5cfec -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:43 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d1a179-0142-440c-9a9a-238ac0b5cfec -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 Jul 31 07:40:43 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:43 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d1a179-0142-440c-9a9a-238ac0b5cfec -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67" returned: 0 in 0.291s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:43 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 is being set with open permissions: ugo+rw Jul 31 07:40:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:43 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 Jul 31 07:40:43 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:44 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67" returned: 0 in 0.237s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:44 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.info Jul 31 07:40:44 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:44 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.info" returned: 0 in 0.244s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:44 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.info is being set with open permissions: ugo+rw Jul 31 07:40:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:44 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.info Jul 31 07:40:44 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:44 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.info" returned: 0 in 0.232s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ffcff2ce-6092-45d6-b7a5-dc0bbcd71c19 tempest-SnapshotDependencyTests-1260198660 None] Create snapshot completed successfully Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Flow 'volume_create_manager' (85bad3d8-46fa-4f8a-9d56-6128cab87dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35f447c-79c5-4d72-997e-ebcf35521480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35f447c-79c5-4d72-997e-ebcf35521480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7dffcf-f1a0-4e5a-90e4-336cbfc63422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca5e3d6562149e69103783c2e075bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=256d79f4-69df-407b-b771-1c403a460e67,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:40:45Z,use_quota=True,user_id='19d2997d02294ce09b7c01b91d9e8a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5b4775-1173-4e03-a309-b2c68eb428db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5b4775-1173-4e03-a309-b2c68eb428db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9f2811-9959-40da-be0e-b5a2a6d49222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9f2811-9959-40da-be0e-b5a2a6d49222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f7dffcf-f1a0-4e5a-90e4-336cbfc63422', 'volume_name': 'volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422', 'volume_size': 1, 'snapshot_id': '256d79f4-69df-407b-b771-1c403a460e67'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448400e7-e62c-4950-bf9d-81d4ff518339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448400e7-e62c-4950-bf9d-81d4ff518339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9d0144-7dae-44cf-be10-0356af68e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Volume 3f7dffcf-f1a0-4e5a-90e4-336cbfc63422: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422', 'volume_size': 1, 'snapshot_id': '256d79f4-69df-407b-b771-1c403a460e67'} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-quobyte-256d79f4-69df-407b-b771-1c403a460e67-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-256d79f4-69df-407b-b771-1c403a460e67-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Creating volume 3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 from snapshot 256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-quobyte-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] snapshot: 256d79f4-69df-407b-b771-1c403a460e67, volume: 3f7dffcf-f1a0-4e5a-90e4-336cbfc63422, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab391e8-2572-45ee-a31b-bcd0f6a74b0b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:45 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 Jul 31 07:40:45 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:46 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67" returned: 0 in 0.345s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d1a179-0142-440c-9a9a-238ac0b5cfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe5bc2-6033-4bde-b2d5-9a0bf3366d0c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:46 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec Jul 31 07:40:46 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:46 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec" returned: 0 in 0.344s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:40:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:46 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 Jul 31 07:40:46 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:50 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" returned: 0 in 4.050s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:50 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9236c60-5891-4ce5-bb80-8ec7f3b7e8b8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:50 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec Jul 31 07:40:50 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:50 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec" returned: 0 in 0.519s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:50 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:40:50 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Converted 1024.00 MB image at 252.73 MB/s Jul 31 07:40:50 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 is being set with open permissions: ugo+rw Jul 31 07:40:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:50 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 Jul 31 07:40:50 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:51 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" returned: 0 in 0.238s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" released by "_copy_volume_from_snapshot" :: held 5.582s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-256d79f4-69df-407b-b771-1c403a460e67-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" released by "_create_volume_from_snapshot" :: held 5.610s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.623s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9d0144-7dae-44cf-be10-0356af68e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422', 'volume_size': 1, 'snapshot_id': '256d79f4-69df-407b-b771-1c403a460e67'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ef88ac-e156-4259-a3f0-9a415593f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:40:51 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Volume volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 (3f7dffcf-f1a0-4e5a-90e4-336cbfc63422): created successfully Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ef88ac-e156-4259-a3f0-9a415593f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:40:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Flow 'volume_create_manager' (85bad3d8-46fa-4f8a-9d56-6128cab87dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:40:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-22107273-7768-4aeb-8212-c00d320cd83d tempest-SnapshotDependencyTests-1260198660 None] Created volume successfully. Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-256d79f4-69df-407b-b771-1c403a460e67-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-256d79f4-69df-407b-b771-1c403a460e67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-quobyte-05d1a179-0142-440c-9a9a-238ac0b5cfec" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-05d1a179-0142-440c-9a9a-238ac0b5cfec" acquired by "delete_snapshot" :: waited 0.011s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-quobyte-256d79f4-69df-407b-b771-1c403a460e67" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-256d79f4-69df-407b-b771-1c403a460e67" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Deleting offline snapshot 256d79f4-69df-407b-b771-1c403a460e67 of volume 05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] snapshot_file for this snap is: volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b201607f-25fe-4907-a1b4-3099b2d5f557]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:52 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 Jul 31 07:40:52 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:52 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67" returned: 0 in 0.334s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d1a179-0142-440c-9a9a-238ac0b5cfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb4ff61-0fe9-44d7-b828-3e182734b03a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:52 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec Jul 31 07:40:52 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:52 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec" returned: 0 in 0.333s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:52 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 Jul 31 07:40:52 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:53 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:53 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67 Jul 31 07:40:53 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:53 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec.256d79f4-69df-407b-b771-1c403a460e67" returned: 0 in 0.237s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-256d79f4-69df-407b-b771-1c403a460e67" released by "_delete_snapshot" :: held 1.320s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-05d1a179-0142-440c-9a9a-238ac0b5cfec" released by "delete_snapshot" :: held 1.344s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:53 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Created reservations ['9ab4ce8b-d244-4bc2-a809-46f2a7a2e63c', '269a8adc-9059-4887-bf14-0a51f3f7ebe8', '2411f8ea-5ccd-4547-a2ea-949ee628e6d0', 'ac6d6843-8419-43cc-a64a-d428636a6e5f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Delete snapshot completed successfully. Jul 31 07:40:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6cdcdb94-dab0-4f5d-98ad-e36f5f02db3a tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-256d79f4-69df-407b-b771-1c403a460e67-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-05d1a179-0142-440c-9a9a-238ac0b5cfec-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-05d1a179-0142-440c-9a9a-238ac0b5cfec-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-quobyte-05d1a179-0142-440c-9a9a-238ac0b5cfec" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-05d1a179-0142-440c-9a9a-238ac0b5cfec" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf75091d-a09c-4d7f-af89-fb48148c7295]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:54 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec Jul 31 07:40:54 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:54 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec" returned: 0 in 0.349s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:54 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec Jul 31 07:40:54 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:54 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05d1a179-0142-440c-9a9a-238ac0b5cfec" returned: 0 in 0.240s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-05d1a179-0142-440c-9a9a-238ac0b5cfec" released by "delete_volume" :: held 0.642s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Created reservations ['2b2ac50d-9bf2-4e00-a1b4-73b95307df27', 'c84cb695-8c41-42bd-9044-dfbcfec9df6c', '1af92c41-e197-4af7-834a-6a8f1be57f63', 'f4926165-85ec-42c1-b19e-5fdd04cd30fc'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:55 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:40:55 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:55 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.233s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:40:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Deleted volume successfully. Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b032fbd-8f14-4f5c-9aa4-62cd094fabed tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-05d1a179-0142-440c-9a9a-238ac0b5cfec-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "cinder-quobyte-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e070013a-3e56-49ff-9acb-04f11663327d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:55 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 Jul 31 07:40:55 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:55 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" returned: 0 in 0.343s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:55 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422 Jul 31 07:40:55 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:56 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-quobyte-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422" released by "delete_volume" :: held 0.625s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Created reservations ['d3cef81e-e813-4271-8896-f1c77ddaeb24', 'f0649b18-c821-4925-aae7-14956ccd3f93', 'bd93b2ea-f162-4f3a-99a7-796176cb17d1', '60dbed15-040d-4b48-8852-22ee36285753'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:40:56 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:40:56 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:40:56 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.237s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:40:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Deleted volume successfully. Jul 31 07:40:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-66e8ce93-15d3-4b02-8bf9-b078e63e162f tempest-SnapshotDependencyTests-1260198660 None] Lock "cinder-3f7dffcf-f1a0-4e5a-90e4-336cbfc63422-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:06 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:41:06 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=5 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Flow 'volume_create_manager' (5133b4b0-eaac-4bb9-995f-f630a382e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6792b2e1-05ae-49a4-8607-434cf588b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6792b2e1-05ae-49a4-8607-434cf588b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1446624080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2426ada6-825e-4bf3-9d92-3862f8514baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef76b8ce26a4dae8c4acdb69a4f78ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:15Z,use_quota=True,user_id='c0d8001a61774db295d4e3fdc6989dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a12b16-1fdb-4ebc-b42f-e5108ea422a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a12b16-1fdb-4ebc-b42f-e5108ea422a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24882633-120a-4513-8020-24dc53e63901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24882633-120a-4513-8020-24dc53e63901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2426ada6-825e-4bf3-9d92-3862f8514baf', 'volume_name': 'volume-2426ada6-825e-4bf3-9d92-3862f8514baf', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be039fad-2ae3-4fd9-b2e9-7675a13ae1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be039fad-2ae3-4fd9-b2e9-7675a13ae1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8caa7e-0b5c-414b-9f78-f622aa138e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Volume 2426ada6-825e-4bf3-9d92-3862f8514baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2426ada6-825e-4bf3-9d92-3862f8514baf', 'volume_size': 1} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1446624080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2426ada6-825e-4bf3-9d92-3862f8514baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef76b8ce26a4dae8c4acdb69a4f78ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:15Z,use_quota=True,user_id='c0d8001a61774db295d4e3fdc6989dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Creating volume 2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:14 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:14 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf 1073741824 Jul 31 07:41:14 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (b131801d-2576-47fc-bf53-57f8d39828de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7eaf70-833b-4e05-a045-3a3630962d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7eaf70-833b-4e05-a045-3a3630962d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1078528981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:15Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdad1102-0300-4db1-8b42-4c1df35d6c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdad1102-0300-4db1-8b42-4c1df35d6c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c208cdfe-d0ad-4129-b6fc-f80e5e14061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c208cdfe-d0ad-4129-b6fc-f80e5e14061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5', 'volume_name': 'volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d421a05f-3740-4173-82a4-2fbbae42db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d421a05f-3740-4173-82a4-2fbbae42db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f693fa-adc2-414e-8237-6b0d80fa673c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Volume 0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5', 'volume_size': 1} Jul 31 07:41:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (1a1c30e5-25c5-40c1-b88f-1005ae83b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df9100a-cc8a-4c5b-a0d9-b3ef7390ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df9100a-cc8a-4c5b-a0d9-b3ef7390ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223425475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972ca9a7-9c6f-407a-9cfe-047c9e3e7019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:15Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f28577-dde9-458e-8b8d-0635fb7f682a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f28577-dde9-458e-8b8d-0635fb7f682a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f102aa2-4345-4db5-bae5-036828491fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f102aa2-4345-4db5-bae5-036828491fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972ca9a7-9c6f-407a-9cfe-047c9e3e7019', 'volume_name': 'volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b318b1f7-c9d7-4a00-a8fa-a1ed331e8eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b318b1f7-c9d7-4a00-a8fa-a1ed331e8eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b29f0e-b5ad-45c8-a0df-36a4eb4600f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Volume 972ca9a7-9c6f-407a-9cfe-047c9e3e7019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019', 'volume_size': 1} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:15 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf 1073741824" returned: 0 in 0.557s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:15 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf Jul 31 07:41:15 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:15 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (1fa5fa7a-7dad-423b-a76c-2e3b9a66442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe8b0e7-66d4-49d8-b720-4ce80ce74b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf" returned: 0 in 0.417s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1078528981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:15Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Creating volume 0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:15 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe8b0e7-66d4-49d8-b720-4ce80ce74b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125250886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb5968-9fec-4e03-a607-efd9bcb4a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 1073741824 Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb5968-9fec-4e03-a607-efd9bcb4a336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be4e8b9-6458-447b-8fa1-4eace28e2dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be4e8b9-6458-447b-8fa1-4eace28e2dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb', 'volume_name': 'volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e6d930-c0e0-40dd-a348-64e128be52f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e6d930-c0e0-40dd-a348-64e128be52f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abbb8d1-b7de-4709-9b37-4e68dff248aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb', 'volume_size': 1} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8caa7e-0b5c-414b-9f78-f622aa138e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2426ada6-825e-4bf3-9d92-3862f8514baf', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd4dea-0479-4c11-9814-a9312c66f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (6f6f30fc-2437-4956-be6c-d4b2781a25aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8ddc0-726d-4778-87ae-d37ef895ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Volume volume-2426ada6-825e-4bf3-9d92-3862f8514baf (2426ada6-825e-4bf3-9d92-3862f8514baf): created successfully Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd4dea-0479-4c11-9814-a9312c66f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Flow 'volume_create_manager' (5133b4b0-eaac-4bb9-995f-f630a382e035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8ddc0-726d-4778-87ae-d37ef895ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018286914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadc4322-eeb6-41cf-aac4-b444eebadc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d2503b-49f0-4e1b-b833-b97446e6bec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d2503b-49f0-4e1b-b833-b97446e6bec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079b28a0-c50b-4e69-827f-741a166b9565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079b28a0-c50b-4e69-827f-741a166b9565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadc4322-eeb6-41cf-aac4-b444eebadc27', 'volume_name': 'volume-eadc4322-eeb6-41cf-aac4-b444eebadc27', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4be1ee-69e2-4493-a4fb-7aa9cb1b58d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4be1ee-69e2-4493-a4fb-7aa9cb1b58d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3ca836-81e9-45e9-b37c-c5d907bd8756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Volume eadc4322-eeb6-41cf-aac4-b444eebadc27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadc4322-eeb6-41cf-aac4-b444eebadc27', 'volume_size': 1} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (992c98a6-6933-4e86-837f-f8784abfc872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0a8ed0-4a5e-4d9d-86e1-1a732f1f730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-25ccfbd5-2e6a-4148-970c-be5d8f31ffef tempest-VolumeDependencyTests-1583122794 None] Created volume successfully. Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0a8ed0-4a5e-4d9d-86e1-1a732f1f730e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576412477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ecfdb2-76d3-4d12-855f-c6f2b45591ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35d5027-b59c-4a97-a6b2-0c52d0b9f97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35d5027-b59c-4a97-a6b2-0c52d0b9f97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceb2e3e-be16-4c5a-abd8-32a2fd508951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceb2e3e-be16-4c5a-abd8-32a2fd508951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ecfdb2-76d3-4d12-855f-c6f2b45591ee', 'volume_name': 'volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70ce808-979f-4879-b200-1b4941335555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70ce808-979f-4879-b200-1b4941335555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeec0217-7f5d-44f1-9fa2-a0abbb2c51e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Volume f5ecfdb2-76d3-4d12-855f-c6f2b45591ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee', 'volume_size': 1} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (5536b696-e88b-49d8-a3c6-9b36a8b65147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b569f-da47-4cb5-9f87-812fdd359bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b569f-da47-4cb5-9f87-812fdd359bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-218808061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceac8024-b9d8-433b-acc6-e634a0599703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3652923f-8050-41a6-a582-6abe1e270449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3652923f-8050-41a6-a582-6abe1e270449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b5cac6-6441-4739-b95d-ac70a8aa2530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b5cac6-6441-4739-b95d-ac70a8aa2530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceac8024-b9d8-433b-acc6-e634a0599703', 'volume_name': 'volume-ceac8024-b9d8-433b-acc6-e634a0599703', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66f0c60-6a32-4675-bd0e-25a0f45c1c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66f0c60-6a32-4675-bd0e-25a0f45c1c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927d08b6-9aac-4811-805c-ebfecf3001be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Volume ceac8024-b9d8-433b-acc6-e634a0599703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceac8024-b9d8-433b-acc6-e634a0599703', 'volume_size': 1} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 1073741824" returned: 0 in 0.642s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:16 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 Jul 31 07:41:16 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:16 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5" returned: 0 in 0.272s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223425475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972ca9a7-9c6f-407a-9cfe-047c9e3e7019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:15Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Creating volume 972ca9a7-9c6f-407a-9cfe-047c9e3e7019 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f693fa-adc2-414e-8237-6b0d80fa673c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 1073741824 Jul 31 07:41:16 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d294adb7-4a24-4ff4-bdee-e5749000dce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Volume volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 (0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5): created successfully Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d294adb7-4a24-4ff4-bdee-e5749000dce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (b131801d-2576-47fc-bf53-57f8d39828de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-dcec2bed-a34f-4ec0-a449-b86d978d1f42 tempest-CreateVolumesFromImageTest-1438690266 None] Created volume successfully. Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:17 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 1073741824" returned: 0 in 0.507s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:17 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 Jul 31 07:41:17 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:17 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019" returned: 0 in 0.248s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125250886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Creating volume d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:17 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:17 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb 1073741824 Jul 31 07:41:17 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b29f0e-b5ad-45c8-a0df-36a4eb4600f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55315e7-9aef-417c-83c8-3e250fd40efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:17 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Volume volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 (972ca9a7-9c6f-407a-9cfe-047c9e3e7019): created successfully Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55315e7-9aef-417c-83c8-3e250fd40efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (1a1c30e5-25c5-40c1-b88f-1005ae83b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:17 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-82b41886-6a25-478c-b38d-47e1483831f1 tempest-CreateVolumesFromImageTest-1438690266 None] Created volume successfully. Jul 31 07:41:18 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb 1073741824" returned: 0 in 0.423s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:18 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb Jul 31 07:41:18 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:18 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb" returned: 0 in 0.252s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.260s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018286914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadc4322-eeb6-41cf-aac4-b444eebadc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Creating volume eadc4322-eeb6-41cf-aac4-b444eebadc27 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:18 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abbb8d1-b7de-4709-9b37-4e68dff248aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:18 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 1073741824 Jul 31 07:41:18 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ace4634-8fcf-41fd-a8b2-7191c755873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:18 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb (d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb): created successfully Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ace4634-8fcf-41fd-a8b2-7191c755873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (1fa5fa7a-7dad-423b-a76c-2e3b9a66442c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3f0284dc-cbcc-4945-820a-e3b255bf2081 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created volume successfully. Jul 31 07:41:18 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 1073741824" returned: 0 in 0.511s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:18 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 Jul 31 07:41:18 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Flow 'volume_create_manager' (25b22c11-3b8a-47c1-96e3-8bd6b38205a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0037ada-dcb4-477f-9d23-f3a0ec00ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0037ada-dcb4-477f-9d23-f3a0ec00ff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d540375-c321-46bc-b7f1-c96a793db197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6218b6bd246ed802447f84eecfbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:19Z,use_quota=True,user_id='273ffebcd94640a48236c8b73ab6526b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b36a277-d82b-4663-9006-ad0eb9d43567),volume_type_id=1b36a277-d82b-4663-9006-ad0eb9d43567)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5669e77f-917b-4114-bb32-4444d213270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5669e77f-917b-4114-bb32-4444d213270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78159fef-36e3-43cd-a9d5-7e3929921afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:19 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (8f610ab1-2eab-495d-b5eb-24bf1d26beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e7f008-b231-42c3-b93f-078f76171cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27" returned: 0 in 0.452s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.184s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576412477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ecfdb2-76d3-4d12-855f-c6f2b45591ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Creating volume f5ecfdb2-76d3-4d12-855f-c6f2b45591ee {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:19 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e7f008-b231-42c3-b93f-078f76171cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140186541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d18c980-9ff2-41b7-8c56-d8266a369e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:19Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee 1073741824 Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787017fc-808a-44ae-bf5b-76461e685f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787017fc-808a-44ae-bf5b-76461e685f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc60d06-71d5-49f5-a0ad-f93deb956dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc60d06-71d5-49f5-a0ad-f93deb956dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d18c980-9ff2-41b7-8c56-d8266a369e63', 'volume_name': 'volume-5d18c980-9ff2-41b7-8c56-d8266a369e63', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adc75a1-dbbd-4f0c-a561-31afdb803fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adc75a1-dbbd-4f0c-a561-31afdb803fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9b2298-0c49-4545-94ef-18885a66d6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume 5d18c980-9ff2-41b7-8c56-d8266a369e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d18c980-9ff2-41b7-8c56-d8266a369e63', 'volume_size': 1} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3ca836-81e9-45e9-b37c-c5d907bd8756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadc4322-eeb6-41cf-aac4-b444eebadc27', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fcea0d-5892-4373-97ec-ff8169c93216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Volume volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 (eadc4322-eeb6-41cf-aac4-b444eebadc27): created successfully Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fcea0d-5892-4373-97ec-ff8169c93216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (6f6f30fc-2437-4956-be6c-d4b2781a25aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:19 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-34023b8f-0f6d-471b-9462-219012c339d0 tempest-CreateVolumesFromImageTest-1438690266 None] Created volume successfully. Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78159fef-36e3-43cd-a9d5-7e3929921afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d540375-c321-46bc-b7f1-c96a793db197', 'volume_name': 'volume-1d540375-c321-46bc-b7f1-c96a793db197', 'volume_size': 1, 'image_id': 'fc059cc9-7c95-4127-ac09-da71c8141380', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc059cc9-7c95-4127-ac09-da71c8141380', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb0aa6d43a0faed29e0981f8b2887364', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16d6218b6bd246ed802447f84eecfbf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2e382f999e1b4b6743b81dbe3a106fe3b4b58d28836cb00cf7c9c3887248d2745f506ed1b7000ab0876277d7c00b8ad049ac58d359c6cc85264e2c1527180dd1', 'id': 'fc059cc9-7c95-4127-ac09-da71c8141380', 'created_at': datetime.datetime(2026, 7, 31, 5, 41, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc059cc9-7c95-4127-ac09-da71c8141380/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a0aaa8-8815-435b-8621-2b6c42da8610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a0aaa8-8815-435b-8621-2b6c42da8610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a338d14-6dc4-48ca-ad2d-f988b8894d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Volume 1d540375-c321-46bc-b7f1-c96a793db197: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d540375-c321-46bc-b7f1-c96a793db197', 'volume_size': 1, 'image_id': 'fc059cc9-7c95-4127-ac09-da71c8141380', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc059cc9-7c95-4127-ac09-da71c8141380', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb0aa6d43a0faed29e0981f8b2887364', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16d6218b6bd246ed802447f84eecfbf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2e382f999e1b4b6743b81dbe3a106fe3b4b58d28836cb00cf7c9c3887248d2745f506ed1b7000ab0876277d7c00b8ad049ac58d359c6cc85264e2c1527180dd1', 'id': 'fc059cc9-7c95-4127-ac09-da71c8141380', 'created_at': datetime.datetime(2026, 7, 31, 5, 41, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc059cc9-7c95-4127-ac09-da71c8141380/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Trying to clone 1d540375-c321-46bc-b7f1-c96a793db197 from image fc059cc9-7c95-4127-ac09-da71c8141380 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc059cc9-7c95-4127-ac09-da71c8141380', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:41:19 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Image download 0.00 MB at 0.00 MB/s Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[830c451d-595b-4978-a211-8b213bf45ee8]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (551c8618-deaf-497e-9040-8f43a652deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120970ef-5ef6-4a81-8815-b26769c7c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120970ef-5ef6-4a81-8815-b26769c7c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1992144043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1c53ff-79c2-4942-a4e7-014adbf916c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:20Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200b26aa-a2a1-4515-82df-dbba880443f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200b26aa-a2a1-4515-82df-dbba880443f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f37006-51cf-4f79-a377-7b1040579f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f37006-51cf-4f79-a377-7b1040579f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1c53ff-79c2-4942-a4e7-014adbf916c2', 'volume_name': 'volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0d2d91-c23d-4ffb-8103-3f25a59fa2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0d2d91-c23d-4ffb-8103-3f25a59fa2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a67bcee-0f29-44ce-973a-62bd8773d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume 1e1c53ff-79c2-4942-a4e7-014adbf916c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2', 'volume_size': 1} Jul 31 07:41:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:20 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD Jul 31 07:41:20 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:20 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee 1073741824" returned: 0 in 0.587s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:20 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee Jul 31 07:41:20 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:20 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (6aa7ec52-e897-4728-acbc-b1d563c813be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8634f94-2c96-4564-a1bd-3e99b78c3252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8634f94-2c96-4564-a1bd-3e99b78c3252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442632328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4a08f-d64d-46a7-a755-1bd06858bb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:20Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c98c862-387e-441d-b132-ca39316ac77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c98c862-387e-441d-b132-ca39316ac77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2789b9-a91c-494b-86d2-78e7be0bb1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2789b9-a91c-494b-86d2-78e7be0bb1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed4a08f-d64d-46a7-a755-1bd06858bb51', 'volume_name': 'volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b408a96-0ca7-4692-900f-f2c29e6c1e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b408a96-0ca7-4692-900f-f2c29e6c1e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520cbcd5-d35f-49ba-86ce-95243ce197aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume 0ed4a08f-d64d-46a7-a755-1bd06858bb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51', 'volume_size': 1} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:20 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee" returned: 0 in 0.314s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.846s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-218808061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceac8024-b9d8-433b-acc6-e634a0599703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476d16c4bad4485e8b4148edd5c0dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:16Z,use_quota=True,user_id='a9b13b01caa8446caec7a7ee8473fd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Creating volume ceac8024-b9d8-433b-acc6-e634a0599703 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:20 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeec0217-7f5d-44f1-9fa2-a0abbb2c51e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb737d7e-08da-46f2-bf90-429e18f89e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 1073741824 Jul 31 07:41:20 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:20 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD Jul 31 07:41:20 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:20 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Volume volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee (f5ecfdb2-76d3-4d12-855f-c6f2b45591ee): created successfully Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb737d7e-08da-46f2-bf90-429e18f89e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (992c98a6-6933-4e86-837f-f8784abfc872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:20 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-da795ad9-1a62-4af0-84fd-14d9534a346f tempest-CreateVolumesFromImageTest-1438690266 None] Created volume successfully. Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (1405d8fa-74e4-41a9-942f-719fd1ecb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cb2b94-32bc-49f3-804b-554b7adeb317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Temporary image fc059cc9-7c95-4127-ac09-da71c8141380 is fetched for user 273ffebcd94640a48236c8b73ab6526b. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cb2b94-32bc-49f3-804b-554b7adeb317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840608190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f12b1e8-826f-4e4b-98fb-00a0d0c00c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:21Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8906031-fcbc-4c9c-8cef-0eac26e934b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8906031-fcbc-4c9c-8cef-0eac26e934b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b3f9c6-99cb-495a-811d-c316a9f3c9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b3f9c6-99cb-495a-811d-c316a9f3c9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f12b1e8-826f-4e4b-98fb-00a0d0c00c33', 'volume_name': 'volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64facf59-92fb-404f-88fc-d6e7713858eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64facf59-92fb-404f-88fc-d6e7713858eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e53df4-eb5b-4eab-9e27-b66937e892e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:20 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume 9f12b1e8-826f-4e4b-98fb-00a0d0c00c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33', 'volume_size': 1} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da793c-72a4-4531-b90f-911a3c78c861]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:20 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD Jul 31 07:41:20 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:20 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 1073741824" returned: 0 in 0.594s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:21 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 Jul 31 07:41:21 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (4b908539-19f4-4548-a1cd-324316e6d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4547203-35a9-4959-8c41-32cf5da3068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4547203-35a9-4959-8c41-32cf5da3068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626565830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca97e898-760d-4913-99fe-c702e0818b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:21Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4365136b-119a-46da-b443-d2fc5d2d3d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4365136b-119a-46da-b443-d2fc5d2d3d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c4eb68-5754-4440-a9a9-c1c4a101a0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:21 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c4eb68-5754-4440-a9a9-c1c4a101a0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca97e898-760d-4913-99fe-c702e0818b85', 'volume_name': 'volume-ca97e898-760d-4913-99fe-c702e0818b85', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa8e66-061d-4981-9533-14d8b1aceaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa8e66-061d-4981-9533-14d8b1aceaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aad397c-fbf2-4686-836c-b91948a0f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:21 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume ca97e898-760d-4913-99fe-c702e0818b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca97e898-760d-4913-99fe-c702e0818b85', 'volume_size': 1} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:21 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.276s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927d08b6-9aac-4811-805c-ebfecf3001be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceac8024-b9d8-433b-acc6-e634a0599703', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84813cb8-9cc4-48da-b3ef-710940519e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Creating offline snapshot 816ddafe-4300-4ac6-9fc9-bb71a223d830 of volume 2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:41:21 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Volume volume-ceac8024-b9d8-433b-acc6-e634a0599703 (ceac8024-b9d8-433b-acc6-e634a0599703): created successfully Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84813cb8-9cc4-48da-b3ef-710940519e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Flow 'volume_create_manager' (5536b696-e88b-49d8-a3c6-9b36a8b65147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:21 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD Jul 31 07:41:21 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4cba1b-513e-4d2f-8275-bb2ef7afbce9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c81c14a6-0d3a-4251-b60c-86fb6114790f tempest-CreateVolumesFromImageTest-1438690266 None] Created volume successfully. Jul 31 07:41:21 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf Jul 31 07:41:21 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:21 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:21 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf" returned: 0 in 0.347s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:21 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 1G Jul 31 07:41:21 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-ceac8024-b9d8-433b-acc6-e634a0599703-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-ceac8024-b9d8-433b-acc6-e634a0599703-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-quobyte-ceac8024-b9d8-433b-acc6-e634a0599703" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-ceac8024-b9d8-433b-acc6-e634a0599703" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:22 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 1G" returned: 0 in 0.428s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2426ada6-825e-4bf3-9d92-3862f8514baf -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1664d2-f85d-4de1-aea1-5070c2e140cd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:22 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2426ada6-825e-4bf3-9d92-3862f8514baf -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 Jul 31 07:41:22 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:22 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 Jul 31 07:41:22 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:22 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2426ada6-825e-4bf3-9d92-3862f8514baf -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830" returned: 0 in 0.298s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:22 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 is being set with open permissions: ugo+rw Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:22 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 Jul 31 07:41:22 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:22 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703" returned: 0 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:22 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703 Jul 31 07:41:22 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:22 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830" returned: 0 in 0.246s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:22 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.info Jul 31 07:41:22 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:22 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ceac8024-b9d8-433b-acc6-e634a0599703" returned: 0 in 0.248s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-ceac8024-b9d8-433b-acc6-e634a0599703" released by "delete_volume" :: held 0.657s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Created reservations ['9e27d887-a53e-46c6-8500-bfbd46b4801a', 'e8115746-96ec-4835-bc47-a29675d5f1dc', '9e3c8f61-7f8a-4347-8c37-a10eb24364ff', '189902fb-50e2-4412-ace5-0b3c01c706c4'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:22 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:22 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:22 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.info" returned: 0 in 0.261s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:22 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.info is being set with open permissions: ugo+rw Jul 31 07:41:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:22 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.info Jul 31 07:41:22 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:23 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Deleted volume successfully. Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-306bffc1-f990-4a9e-b4ae-f345c08d7b58 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-ceac8024-b9d8-433b-acc6-e634a0599703-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:23 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.info" returned: 0 in 0.267s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.766s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140186541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d18c980-9ff2-41b7-8c56-d8266a369e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:19Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Creating volume 5d18c980-9ff2-41b7-8c56-d8266a369e63 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:23 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:23 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 1073741824 Jul 31 07:41:23 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-eb583750-a56b-4109-967c-156af95c3cf2 tempest-VolumeDependencyTests-1583122794 None] Create snapshot completed successfully Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-quobyte-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[866738e7-d21d-45ed-b71e-46650bd825e5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:23 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee Jul 31 07:41:23 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:23 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 1073741824" returned: 0 in 0.401s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:23 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 Jul 31 07:41:23 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:23 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee" returned: 0 in 0.380s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:23 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee Jul 31 07:41:23 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:23 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63" returned: 0 in 0.249s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.996s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1992144043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1c53ff-79c2-4942-a4e7-014adbf916c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:20Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Creating volume 1e1c53ff-79c2-4942-a4e7-014adbf916c2 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:23 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9b2298-0c49-4545-94ef-18885a66d6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d18c980-9ff2-41b7-8c56-d8266a369e63', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:23 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 1073741824 Jul 31 07:41:23 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:23 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f409aa92-df45-40d6-a28c-5a74bf1a0263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:23 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee" returned: 0 in 0.248s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee" released by "delete_volume" :: held 0.671s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:24 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 (5d18c980-9ff2-41b7-8c56-d8266a369e63): created successfully Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f409aa92-df45-40d6-a28c-5a74bf1a0263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (8f610ab1-2eab-495d-b5eb-24bf1d26beee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-195b6391-827a-4807-98ba-4d641f61b565 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created volume successfully. Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Created reservations ['24ced740-dc03-4341-9791-301627a1d983', 'cce7fb28-e795-4873-a9e2-c78fff4a2653', '9f758ba8-d575-4c65-af39-35d7e3e6784c', '13c9e0a3-c83b-4545-9ded-725a98bf35c1'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:24 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:24 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-eadc4322-eeb6-41cf-aac4-b444eebadc27-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-eadc4322-eeb6-41cf-aac4-b444eebadc27-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:24 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.307s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:24 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Deleted volume successfully. Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 1073741824" returned: 0 in 0.516s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-quobyte-eadc4322-eeb6-41cf-aac4-b444eebadc27" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9698e8bf-c587-4764-b714-ae863f34c186 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-f5ecfdb2-76d3-4d12-855f-c6f2b45591ee-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-eadc4322-eeb6-41cf-aac4-b444eebadc27" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[125573aa-749c-47e5-ac56-1fbc030592bd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:24 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 Jul 31 07:41:24 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:24 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 Jul 31 07:41:24 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:24 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2" returned: 0 in 0.288s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.496s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442632328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4a08f-d64d-46a7-a755-1bd06858bb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:20Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Creating volume 0ed4a08f-d64d-46a7-a755-1bd06858bb51 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:24 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a67bcee-0f29-44ce-973a-62bd8773d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:24 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 1073741824 Jul 31 07:41:24 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8926e9a1-c741-4f74-b886-d2ed4f4d7d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:24 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 (1e1c53ff-79c2-4942-a4e7-014adbf916c2): created successfully Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8926e9a1-c741-4f74-b886-d2ed4f4d7d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (551c8618-deaf-497e-9040-8f43a652deec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8e2abce9-fc58-4114-8282-1d80d09cef84 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created volume successfully. Jul 31 07:41:24 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:25 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27" returned: 0 in 0.443s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Flow 'volume_create_manager' (3493abfd-0f79-4317-8cf9-791f100ddbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:25 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27 Jul 31 07:41:25 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23711fed-3013-466a-bfa0-fed28e7d0732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23711fed-3013-466a-bfa0-fed28e7d0732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1440881609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e311c0-8095-490c-96fd-5e8e1c7875c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef76b8ce26a4dae8c4acdb69a4f78ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=816ddafe-4300-4ac6-9fc9-bb71a223d830,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:25Z,use_quota=True,user_id='c0d8001a61774db295d4e3fdc6989dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e09d606-efeb-485f-aa08-c4aa556de493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e09d606-efeb-485f-aa08-c4aa556de493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7473b3-3a61-4f37-9a94-9476e754ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7473b3-3a61-4f37-9a94-9476e754ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6e311c0-8095-490c-96fd-5e8e1c7875c8', 'volume_name': 'volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8', 'volume_size': 1, 'snapshot_id': '816ddafe-4300-4ac6-9fc9-bb71a223d830'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bd7e1f-5368-4479-bfd3-8f8acf9e321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bd7e1f-5368-4479-bfd3-8f8acf9e321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6822d9a5-c814-4d72-a038-49b39513c616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:25 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Volume b6e311c0-8095-490c-96fd-5e8e1c7875c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8', 'volume_size': 1, 'snapshot_id': '816ddafe-4300-4ac6-9fc9-bb71a223d830'} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:25 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-eadc4322-eeb6-41cf-aac4-b444eebadc27" returned: 0 in 0.295s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-eadc4322-eeb6-41cf-aac4-b444eebadc27" released by "delete_volume" :: held 0.785s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:25 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 1073741824" returned: 0 in 0.460s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:25 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 Jul 31 07:41:25 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Created reservations ['a1cb0724-f3f1-4985-8538-9d311bdaeed1', 'dfc17a0a-cd0f-4020-bb31-ec31cd329d3d', '131feaab-bc8a-4491-90d3-1740b65a1b64', 'e60e04d3-e1b6-429e-ba0b-29f50aefcd1b'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:25 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:25 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-972ca9a7-9c6f-407a-9cfe-047c9e3e7019-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-972ca9a7-9c6f-407a-9cfe-047c9e3e7019-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:25 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51" returned: 0 in 0.294s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.922s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840608190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f12b1e8-826f-4e4b-98fb-00a0d0c00c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:21Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Creating volume 9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:25 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-quobyte-972ca9a7-9c6f-407a-9cfe-047c9e3e7019" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:25 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 1073741824 Jul 31 07:41:25 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520cbcd5-d35f-49ba-86ce-95243ce197aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c636cb60-adc2-4031-889a-ecd0149d9d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-972ca9a7-9c6f-407a-9cfe-047c9e3e7019" acquired by "delete_volume" :: waited 0.046s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:25 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 (0ed4a08f-d64d-46a7-a755-1bd06858bb51): created successfully Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c636cb60-adc2-4031-889a-ecd0149d9d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (6aa7ec52-e897-4728-acbc-b1d563c813be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e20b52-be2b-49ae-818e-4342b6629a75]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:25 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.316s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Deleted volume successfully. Jul 31 07:41:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c7a2a869-c1dd-4fea-8968-bb492ebc5382 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created volume successfully. Jul 31 07:41:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5bdc9dc8-fb7e-401c-b66a-45c322ce2fd7 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-eadc4322-eeb6-41cf-aac4-b444eebadc27-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:25 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 Jul 31 07:41:25 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:26 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 1073741824" returned: 0 in 0.423s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:26 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019" returned: 0 in 0.375s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:26 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 Jul 31 07:41:26 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:26 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019 Jul 31 07:41:26 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:26 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:26 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33" returned: 0 in 0.249s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.165s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626565830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca97e898-760d-4913-99fe-c702e0818b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af6c2ca14f2410993df0f39d1169630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:21Z,use_quota=True,user_id='0f0127c32fba44428b1c7e9aec9c4cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Creating volume ca97e898-760d-4913-99fe-c702e0818b85 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:26 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-972ca9a7-9c6f-407a-9cfe-047c9e3e7019" returned: 0 in 0.268s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:26 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 1073741824 Jul 31 07:41:26 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e53df4-eb5b-4eab-9e27-b66937e892e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed9bc2-41ac-4576-a593-e77a4330643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-972ca9a7-9c6f-407a-9cfe-047c9e3e7019" released by "delete_volume" :: held 0.720s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:26 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 (9f12b1e8-826f-4e4b-98fb-00a0d0c00c33): created successfully Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed9bc2-41ac-4576-a593-e77a4330643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (1405d8fa-74e4-41a9-942f-719fd1ecb91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:26 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-68b02826-2318-4d27-8bc8-9fccfe732877 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created volume successfully. Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Created reservations ['55f17308-3e2e-423e-b256-5aa7e0dfb5b0', '1a26ef91-fa60-4c9a-b8da-592972b8edd4', '8f219e67-5a59-4566-8bb7-98cd081dc3b5', '7b30ede6-e97e-4fd7-87f2-2be256fa93ac'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:26 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:26 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "cinder-quobyte-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:26 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 1073741824" returned: 0 in 0.504s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522f889-cdd7-47eb-a18a-c077508c8ebf]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:26 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.323s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:26 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Deleted volume successfully. Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c9d5fe8e-4300-43e1-8677-0799f880b0f3 tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-972ca9a7-9c6f-407a-9cfe-047c9e3e7019-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:27 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 Jul 31 07:41:27 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:27 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 Jul 31 07:41:27 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:27 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85" returned: 0 in 0.241s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.668s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d540375-c321-46bc-b7f1-c96a793db197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6218b6bd246ed802447f84eecfbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:19Z,use_quota=True,user_id='273ffebcd94640a48236c8b73ab6526b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b36a277-d82b-4663-9006-ad0eb9d43567),volume_type_id=1b36a277-d82b-4663-9006-ad0eb9d43567)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Creating volume 1d540375-c321-46bc-b7f1-c96a793db197 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:27 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aad397c-fbf2-4686-836c-b91948a0f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca97e898-760d-4913-99fe-c702e0818b85', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60e8da5-42ea-4119-89a3-e5d689111af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:27 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 1073741824 Jul 31 07:41:27 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:27 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Volume volume-ca97e898-760d-4913-99fe-c702e0818b85 (ca97e898-760d-4913-99fe-c702e0818b85): created successfully Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60e8da5-42ea-4119-89a3-e5d689111af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Flow 'volume_create_manager' (4b908539-19f4-4548-a1cd-324316e6d14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:27 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-133d5562-d343-4231-8242-9a76bbd27f18 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created volume successfully. Jul 31 07:41:27 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5 Jul 31 07:41:27 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:27 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5" returned: 0 in 0.256s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-quobyte-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5" released by "delete_volume" :: held 0.688s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Created reservations ['a6931d85-64a7-4cb3-8b06-d78e0e3b6605', '5f74d09e-3ebd-44b4-9374-61be82e7f895', '25b5b1fe-618d-4093-b47f-edbdde719904', '62d9aedf-4d63-4eb0-adb9-26a45f923a1c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:27 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 1073741824" returned: 0 in 0.465s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:27 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:27 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-ca97e898-760d-4913-99fe-c702e0818b85-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:27 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 Jul 31 07:41:27 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-ca97e898-760d-4913-99fe-c702e0818b85-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-quobyte-ca97e898-760d-4913-99fe-c702e0818b85" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-ca97e898-760d-4913-99fe-c702e0818b85" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a6916-f5f6-4712-8cc1-ee34ee4a3a05]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:28 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.312s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Deleted volume successfully. Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-585b171b-1c6c-4268-8599-edbf5f16484d tempest-CreateVolumesFromImageTest-1438690266 None] Lock "cinder-0e66b74d-a857-48eb-b6dc-0c9c8d69e0f5-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:28 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 Jul 31 07:41:28 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:28 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197" returned: 0 in 0.349s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.957s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-quobyte-816ddafe-4300-4ac6-9fc9-bb71a223d830-b6e311c0-8095-490c-96fd-5e8e1c7875c8" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-816ddafe-4300-4ac6-9fc9-bb71a223d830-b6e311c0-8095-490c-96fd-5e8e1c7875c8" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Creating volume b6e311c0-8095-490c-96fd-5e8e1c7875c8 from snapshot 816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-quobyte-b6e311c0-8095-490c-96fd-5e8e1c7875c8" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Attempting download of fc059cc9-7c95-4127-ac09-da71c8141380 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc059cc9-7c95-4127-ac09-da71c8141380', 'metadata': {}}])) to volume 1d540375-c321-46bc-b7f1-c96a793db197. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-b6e311c0-8095-490c-96fd-5e8e1c7875c8" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] snapshot: 816ddafe-4300-4ac6-9fc9-bb71a223d830, volume: b6e311c0-8095-490c-96fd-5e8e1c7875c8, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f47f511-8dc1-4903-8143-e4989e4c17c4]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc059cc9-7c95-4127-ac09-da71c8141380_btfustmz {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c66e50-bfaa-4135-9aa1-a7fd65ea7882]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:28 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc059cc9-7c95-4127-ac09-da71c8141380_btfustmz Jul 31 07:41:28 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:28 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85" returned: 0 in 0.488s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:28 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 Jul 31 07:41:28 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:28 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85 Jul 31 07:41:28 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:28 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc059cc9-7c95-4127-ac09-da71c8141380_btfustmz" returned: 0 in 0.427s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc059cc9-7c95-4127-ac09-da71c8141380_btfustmz {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:28 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-ca97e898-760d-4913-99fe-c702e0818b85" returned: 0 in 0.300s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:28 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830" returned: 0 in 0.445s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2426ada6-825e-4bf3-9d92-3862f8514baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-ca97e898-760d-4913-99fe-c702e0818b85" released by "delete_volume" :: held 0.859s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3fca8d-8134-41c5-8902-07b0518900a9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created reservations ['20689e72-7166-4b21-875a-04f21cc24bc2', '63e0b058-bdd9-4c73-aa2f-ec5ac00f911d', 'f2886eca-a47d-44d3-8c57-451f63375825', '22d1b43a-0d93-44a9-a359-74bd1e45caa0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:28 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc059cc9-7c95-4127-ac09-da71c8141380_btfustmz Jul 31 07:41:28 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:28 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf Jul 31 07:41:28 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:28 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:28 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:29 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc059cc9-7c95-4127-ac09-da71c8141380_btfustmz" returned: 1 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc059cc9-7c95-4127-ac09-da71c8141380_btfustmz' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304a66c-ed89-4bbc-ac57-705ec69575fc]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-quobyte-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2a6614-07a8-4980-8610-49a7cc09bd69]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:29 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf" returned: 0 in 0.588s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:29 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD Jul 31 07:41:29 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:29 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Deleted volume successfully. Jul 31 07:41:29 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 Jul 31 07:41:29 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-87a48654-4fe8-44a6-a652-e35d9f57665d tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-ca97e898-760d-4913-99fe-c702e0818b85-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:29 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 Jul 31 07:41:29 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:29 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD" returned: 0 in 0.485s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:29 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD Jul 31 07:41:29 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:29 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33" returned: 0 in 0.564s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:29 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33 Jul 31 07:41:29 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:30 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD" returned: 1 in 0.686s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] fc059cc9-7c95-4127-ac09-da71c8141380 was raw, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:30 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33" returned: 0 in 0.528s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33" released by "delete_volume" :: held 1.178s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:30 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 Jul 31 07:41:30 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created reservations ['e2425ba0-319a-4fd3-993b-6846f68d94d7', 'd8502f69-a04b-4804-82c3-a63c1476bda4', 'c73b6172-d00a-4d9c-82cc-3f8797955933', '8a56b94c-d5a9-4123-ab46-5452e46e9096'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:30 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:30 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:31 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.338s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:31 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Deleted volume successfully. Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7b93165f-f1be-41c6-9054-e3913aa43813 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-9f12b1e8-826f-4e4b-98fb-00a0d0c00c33-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:31 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-0ed4a08f-d64d-46a7-a755-1bd06858bb51-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197" returned: 0 in 1.381s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc059cc9-7c95-4127-ac09-da71c8141380_ru8kqv96devstack@QuobyteHD, size 0.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:41:31 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-0ed4a08f-d64d-46a7-a755-1bd06858bb51-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:31 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 1G Jul 31 07:41:31 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-quobyte-0ed4a08f-d64d-46a7-a755-1bd06858bb51" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:31 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-0ed4a08f-d64d-46a7-a755-1bd06858bb51" acquired by "delete_volume" :: waited 0.059s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c9bdb7-1e6a-4df5-ac60-09e712bd3c41]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:32 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 Jul 31 07:41:32 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:32 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 1G" returned: 0 in 0.907s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Downloaded image fc059cc9-7c95-4127-ac09-da71c8141380 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc059cc9-7c95-4127-ac09-da71c8141380', 'metadata': {}}])) to volume 1d540375-c321-46bc-b7f1-c96a793db197 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Temporary image fc059cc9-7c95-4127-ac09-da71c8141380 for user 273ffebcd94640a48236c8b73ab6526b is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Marking volume 1d540375-c321-46bc-b7f1-c96a793db197 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Copying metadata from image fc059cc9-7c95-4127-ac09-da71c8141380 to 1d540375-c321-46bc-b7f1-c96a793db197. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Creating volume glance metadata for volume 1d540375-c321-46bc-b7f1-c96a793db197 backed by image fc059cc9-7c95-4127-ac09-da71c8141380 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fc059cc9-7c95-4127-ac09-da71c8141380', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cb0aa6d43a0faed29e0981f8b2887364', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a338d14-6dc4-48ca-ad2d-f988b8894d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d540375-c321-46bc-b7f1-c96a793db197', 'volume_size': 1, 'image_id': 'fc059cc9-7c95-4127-ac09-da71c8141380', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc059cc9-7c95-4127-ac09-da71c8141380', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb0aa6d43a0faed29e0981f8b2887364', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16d6218b6bd246ed802447f84eecfbf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2e382f999e1b4b6743b81dbe3a106fe3b4b58d28836cb00cf7c9c3887248d2745f506ed1b7000ab0876277d7c00b8ad049ac58d359c6cc85264e2c1527180dd1', 'id': 'fc059cc9-7c95-4127-ac09-da71c8141380', 'created_at': datetime.datetime(2026, 7, 31, 5, 41, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc059cc9-7c95-4127-ac09-da71c8141380/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fa71d7-ac47-4086-b7aa-3d8b9c970c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:32 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Volume volume-1d540375-c321-46bc-b7f1-c96a793db197 (1d540375-c321-46bc-b7f1-c96a793db197): created successfully Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fa71d7-ac47-4086-b7aa-3d8b9c970c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:32 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Flow 'volume_create_manager' (25b22c11-3b8a-47c1-96e3-8bd6b38205a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:32 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b2f0d9f6-307f-43b3-8735-becbdc87cad1 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Created volume successfully. Jul 31 07:41:33 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51" returned: 0 in 1.311s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:33 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51 Jul 31 07:41:33 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Acquiring lock "cinder-1d540375-c321-46bc-b7f1-c96a793db197-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "cinder-1d540375-c321-46bc-b7f1-c96a793db197-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Acquiring lock "cinder-quobyte-1d540375-c321-46bc-b7f1-c96a793db197" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:33 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "cinder-quobyte-1d540375-c321-46bc-b7f1-c96a793db197" acquired by "delete_volume" :: waited 0.063s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:33 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf93f0-589e-443a-8004-a32103fed640]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:34 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-0ed4a08f-d64d-46a7-a755-1bd06858bb51" returned: 0 in 0.929s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-0ed4a08f-d64d-46a7-a755-1bd06858bb51" released by "delete_volume" :: held 2.364s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:34 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 Jul 31 07:41:34 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created reservations ['e637e3d3-57a8-4c1b-9e20-b03b5c5dad91', 'be5718f9-a32b-403f-bcbd-731f384b8c86', '601cfa0a-befd-41d2-bb30-40c4fa4a5755', '062ea2f3-1f40-4975-be10-d2073184ea85'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:34 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 1.060s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:41:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:41:34 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:34 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:35 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.691s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:35 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197" returned: 0 in 1.466s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:35 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Deleted volume successfully. Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-1e1c53ff-79c2-4942-a4e7-014adbf916c2-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8" returned: 0 in 6.186s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:35 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197 Jul 31 07:41:35 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-1e1c53ff-79c2-4942-a4e7-014adbf916c2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07d17cf-9dcb-4fd7-acb5-f485c618e8fb]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1072e990-1d0d-4c68-9507-96341ac09278 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-0ed4a08f-d64d-46a7-a755-1bd06858bb51-delete_volume" released by "delete_volume" :: held 3.764s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-quobyte-1e1c53ff-79c2-4942-a4e7-014adbf916c2" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-1e1c53ff-79c2-4942-a4e7-014adbf916c2" acquired by "delete_volume" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[589d92e3-1cc3-48cb-8731-30fbe9c12241]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:35 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf Jul 31 07:41:35 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:35 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 Jul 31 07:41:35 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:35 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1d540375-c321-46bc-b7f1-c96a793db197" returned: 0 in 0.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "cinder-quobyte-1d540375-c321-46bc-b7f1-c96a793db197" released by "delete_volume" :: held 1.986s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:35 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Created reservations ['95865799-b42f-4e4b-b83b-509ab6c31d2b', '8850abc9-c6c0-4bf4-ad9f-f611f8d121b1', '59192f3a-fad7-4bf5-a5dc-7098249055a2', 'a88e5bbf-60aa-495d-aa13-5481554b3611'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:36 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:36 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:36 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2" returned: 0 in 0.537s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:36 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2 Jul 31 07:41:36 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:36 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf" returned: 0 in 0.800s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:41:36 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Converted 1024.00 MB image at 165.48 MB/s Jul 31 07:41:36 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 is being set with open permissions: ugo+rw Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:36 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 Jul 31 07:41:36 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:36 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.291s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Deleted volume successfully. Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19d9a235-e11b-4594-850a-0ade646b0696 tempest-VolumeAndVolumeTypeFromImageTest-1881605409 None] Lock "cinder-1d540375-c321-46bc-b7f1-c96a793db197-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:36 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-1e1c53ff-79c2-4942-a4e7-014adbf916c2" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-1e1c53ff-79c2-4942-a4e7-014adbf916c2" released by "delete_volume" :: held 0.874s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created reservations ['2717c488-c26e-4681-a2e3-8199cc263795', '1d14d533-ce51-4af0-8e37-91ad32c1d1dd', 'a95c5d34-72a5-4371-a314-de6d8152d5e3', 'fde3c2d5-d783-47d8-a277-b5eae0da18fd'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:36 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8" returned: 0 in 0.316s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-b6e311c0-8095-490c-96fd-5e8e1c7875c8" released by "_copy_volume_from_snapshot" :: held 8.513s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:36 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-816ddafe-4300-4ac6-9fc9-bb71a223d830-b6e311c0-8095-490c-96fd-5e8e1c7875c8" released by "_create_volume_from_snapshot" :: held 8.557s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.581s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:36 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6822d9a5-c814-4d72-a038-49b39513c616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8', 'volume_size': 1, 'snapshot_id': '816ddafe-4300-4ac6-9fc9-bb71a223d830'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca79304-8d21-4d3b-b827-a01d328e9f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-5d18c980-9ff2-41b7-8c56-d8266a369e63-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:36 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Volume volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 (b6e311c0-8095-490c-96fd-5e8e1c7875c8): created successfully Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca79304-8d21-4d3b-b827-a01d328e9f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Flow 'volume_create_manager' (3493abfd-0f79-4317-8cf9-791f100ddbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-5d18c980-9ff2-41b7-8c56-d8266a369e63-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1dcb4eb4-0bec-4d56-9098-b7b072c95cba tempest-VolumeDependencyTests-1583122794 None] Created volume successfully. Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-quobyte-5d18c980-9ff2-41b7-8c56-d8266a369e63" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-5d18c980-9ff2-41b7-8c56-d8266a369e63" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c999b0b0-0eaa-414c-bc44-1082c791dbf2]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:36 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.285s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Deleted volume successfully. Jul 31 07:41:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-da9c276d-fec4-43ec-944c-11ce7235750f tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-1e1c53ff-79c2-4942-a4e7-014adbf916c2-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:36 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 Jul 31 07:41:36 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:37 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63" returned: 0 in 0.428s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:37 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63 Jul 31 07:41:37 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-816ddafe-4300-4ac6-9fc9-bb71a223d830-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-816ddafe-4300-4ac6-9fc9-bb71a223d830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-quobyte-2426ada6-825e-4bf3-9d92-3862f8514baf" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-2426ada6-825e-4bf3-9d92-3862f8514baf" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-quobyte-816ddafe-4300-4ac6-9fc9-bb71a223d830" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-816ddafe-4300-4ac6-9fc9-bb71a223d830" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Deleting offline snapshot 816ddafe-4300-4ac6-9fc9-bb71a223d830 of volume 2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] snapshot_file for this snap is: volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d677c4-35cd-48f9-8316-37b75857fcd8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:37 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-5d18c980-9ff2-41b7-8c56-d8266a369e63" returned: 0 in 0.309s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-5d18c980-9ff2-41b7-8c56-d8266a369e63" released by "delete_volume" :: held 0.788s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:37 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 Jul 31 07:41:37 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created reservations ['763be06c-a007-46c1-909a-02d8e82f5cee', 'ff5057c0-e858-4236-8d6e-15dbb8ec62e9', 'cad05479-dea9-4835-a6bc-d5841ae59188', 'fe502c01-98b6-495c-a19b-7b645e785ea8'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:37 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:37 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:37 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830" returned: 0 in 0.523s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2426ada6-825e-4bf3-9d92-3862f8514baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb872e-7917-437b-ac01-89913315bfcf]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "cinder-quobyte-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da963a-231a-41b6-8f2e-55ea61593e89]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:38 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:38 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf Jul 31 07:41:38 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.455s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:38 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Deleted volume successfully. Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7afa0fa6-3f1d-42b8-b715-65688db7b419 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-5d18c980-9ff2-41b7-8c56-d8266a369e63-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:38 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb Jul 31 07:41:38 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:38 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf" returned: 0 in 0.515s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:38 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 Jul 31 07:41:38 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:38 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Flow 'volume_create_manager' (898025ec-73c1-4dbb-8384-d619abe027fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7f2d23-2e25-43eb-9ea4-c555f0ac0717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb" returned: 0 in 0.502s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7f2d23-2e25-43eb-9ea4-c555f0ac0717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030cfe40-52b7-4bb8-8fad-92c7b164de99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa111ddc57c49f1863dfe491453f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:39Z,use_quota=True,user_id='de356e2635ab40328f5a1e27b9b33f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db5072e-6577-4dcf-b34c-388a25855390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db5072e-6577-4dcf-b34c-388a25855390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630ed35c-07bf-4723-93bb-be7111f82d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:38 devstack cinder-volume[88915]: DEBUG cinder.image.glance [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Creating Keystone auth plugin from conf {{(pid=88915) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 07:41:38 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb Jul 31 07:41:38 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:39 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb" returned: 0 in 0.341s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-quobyte-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb" released by "delete_volume" :: held 0.919s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:39 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830" returned: 0 in 0.547s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:39 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830 Jul 31 07:41:39 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630ed35c-07bf-4723-93bb-be7111f82d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '030cfe40-52b7-4bb8-8fad-92c7b164de99', 'volume_name': 'volume-030cfe40-52b7-4bb8-8fad-92c7b164de99', 'volume_size': 1, 'image_id': '2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3b286e82932467425f5667526be2b3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa111ddc57c49f1863dfe491453f2a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ea265c1210cc2fbe1cf7616672a90da6da5b67b6eee17aadd52fe3cfe72812833f6fb2f469f24a596936d8222098e69b1046d26235566ecf36175cb54167e8f', 'id': '2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'created_at': datetime.datetime(2026, 7, 31, 5, 41, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503/file', 'properties': {}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d20aa2e-e998-4fc2-b458-9a51d1f5f269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d20aa2e-e998-4fc2-b458-9a51d1f5f269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244cfaf2-93fe-45dd-87ce-d3d8ad924ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:39 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Volume 030cfe40-52b7-4bb8-8fad-92c7b164de99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-030cfe40-52b7-4bb8-8fad-92c7b164de99', 'volume_size': 1, 'image_id': '2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3b286e82932467425f5667526be2b3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa111ddc57c49f1863dfe491453f2a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ea265c1210cc2fbe1cf7616672a90da6da5b67b6eee17aadd52fe3cfe72812833f6fb2f469f24a596936d8222098e69b1046d26235566ecf36175cb54167e8f', 'id': '2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'created_at': datetime.datetime(2026, 7, 31, 5, 41, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503/file', 'properties': {}}, 'image_service': } Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Trying to clone 030cfe40-52b7-4bb8-8fad-92c7b164de99 from image 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'metadata': {}}]). {{(pid=88915) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Created reservations ['6a660418-431c-4d1e-910b-af85fc5a004f', '0e38d5c0-7a4b-4fbb-85c4-baf5eac7c0c4', '3ee23504-444e-4935-b43b-1f788c6aec7e', 'f98e98d8-e466-4e3c-8d8e-1b204e548656'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 07:41:39 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Image download 0.00 MB at 0.00 MB/s Jul 31 07:41:39 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:39 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[53825473-490d-44e9-82f1-d648b327c60d]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:39 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf.816ddafe-4300-4ac6-9fc9-bb71a223d830" returned: 0 in 0.306s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-816ddafe-4300-4ac6-9fc9-bb71a223d830" released by "_delete_snapshot" :: held 2.075s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-2426ada6-825e-4bf3-9d92-3862f8514baf" released by "delete_snapshot" :: held 2.112s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:39 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD Jul 31 07:41:39 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Created reservations ['941b22a5-1e05-4b89-aab4-d719febcfada', '65e4afc1-1236-4e66-ba6f-83028ce6b47b', 'ff86104a-3f97-4a79-9706-93c9c7feabda', 'e2d0afda-6e44-4b58-bc69-929bf15b9cb4'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:39 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Delete snapshot completed successfully. Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c2f98a1f-7eb3-4714-a06a-642d9425952c tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-816ddafe-4300-4ac6-9fc9-bb71a223d830-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:39 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.406s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:39 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Deleted volume successfully. Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e80ba8ca-65a3-4425-b203-c0cc8ef29ca4 tempest-CreateVolumesFromSourceVolumeTest-302319042 None] Lock "cinder-d2bb2b9f-ff9f-4ab9-8e72-2dac77a9d4cb-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:39 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:40 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD Jul 31 07:41:40 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:40 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Temporary image 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 is fetched for user de356e2635ab40328f5a1e27b9b33f30. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b93d5d-afd3-4376-812a-fcc5dd17d856]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:40 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD Jul 31 07:41:40 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-2426ada6-825e-4bf3-9d92-3862f8514baf-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-2426ada6-825e-4bf3-9d92-3862f8514baf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-quobyte-2426ada6-825e-4bf3-9d92-3862f8514baf" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-2426ada6-825e-4bf3-9d92-3862f8514baf" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:40 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b23620d-2f31-43ac-aecb-24a73eac139f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:40 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD Jul 31 07:41:40 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:40 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf Jul 31 07:41:40 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:41 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD" returned: 1 in 0.430s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030cfe40-52b7-4bb8-8fad-92c7b164de99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa111ddc57c49f1863dfe491453f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:39Z,use_quota=True,user_id='de356e2635ab40328f5a1e27b9b33f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Creating volume 030cfe40-52b7-4bb8-8fad-92c7b164de99 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:41 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:41 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 1073741824 Jul 31 07:41:41 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:41 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf" returned: 0 in 0.506s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:41 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf Jul 31 07:41:41 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:41 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2426ada6-825e-4bf3-9d92-3862f8514baf" returned: 0 in 0.295s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-2426ada6-825e-4bf3-9d92-3862f8514baf" released by "delete_volume" :: held 0.918s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Created reservations ['e3762d1b-0142-4ad5-9adb-bb44db29ac78', 'd1b387fa-f751-44a9-9cd2-469865315886', 'f18f6a3c-6ea3-4a2c-a291-239fd9473d62', 'a0ed1c01-a635-42a7-9e8e-fdd091c2f0a4'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:41 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 1073741824" returned: 0 in 0.632s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:41 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:41 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:41 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 Jul 31 07:41:41 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:42 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.301s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Deleted volume successfully. Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f865e9d2-b460-45f3-a713-502b560255a8 tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-2426ada6-825e-4bf3-9d92-3862f8514baf-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:42 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99" returned: 0 in 0.316s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Attempting download of 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'metadata': {}}])) to volume 030cfe40-52b7-4bb8-8fad-92c7b164de99. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a19046-cd82-4e1f-b092-8e2297897134]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_wu62bpac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:42 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_wu62bpac Jul 31 07:41:42 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:42 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_wu62bpac" returned: 0 in 0.371s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_wu62bpac {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:42 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_wu62bpac Jul 31 07:41:42 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-b6e311c0-8095-490c-96fd-5e8e1c7875c8-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-b6e311c0-8095-490c-96fd-5e8e1c7875c8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "cinder-quobyte-b6e311c0-8095-490c-96fd-5e8e1c7875c8" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-b6e311c0-8095-490c-96fd-5e8e1c7875c8" acquired by "delete_volume" :: waited 0.045s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66a76b2-48a1-4160-91a2-0340f2e4d5f4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:43 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_wu62bpac" returned: 1 in 0.533s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_wu62bpac' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db40c97-bfc0-4f91-9035-588e08cdd0d7]: (4, 'raw') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:43 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 Jul 31 07:41:43 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (704d367e-e2d9-4be7-9cc0-79fc7390f603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a09e33b-dc0b-4516-86fc-2a59746e5ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:43 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD Jul 31 07:41:43 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a09e33b-dc0b-4516-86fc-2a59746e5ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818109925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631bfb8b-78e9-43a1-b2c1-9cbf0d237851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:43Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894645be-e5c8-414a-98ec-668ff3bc3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894645be-e5c8-414a-98ec-668ff3bc3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde94c66-b5ef-471c-9ffa-904e1b467be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde94c66-b5ef-471c-9ffa-904e1b467be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631bfb8b-78e9-43a1-b2c1-9cbf0d237851', 'volume_name': 'volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a46ce4-3a8a-40de-8034-9fa2be772fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a46ce4-3a8a-40de-8034-9fa2be772fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232632f0-5ffc-4798-9071-b6f6e8c3244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:43 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume 631bfb8b-78e9-43a1-b2c1-9cbf0d237851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851', 'volume_size': 1} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818109925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631bfb8b-78e9-43a1-b2c1-9cbf0d237851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:43Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Creating volume 631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:43 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:43 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 1073741824 Jul 31 07:41:43 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:43 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8" returned: 0 in 0.418s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:43 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:43 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8 Jul 31 07:41:43 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:43 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD Jul 31 07:41:43 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:43 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-b6e311c0-8095-490c-96fd-5e8e1c7875c8" returned: 0 in 0.315s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-quobyte-b6e311c0-8095-490c-96fd-5e8e1c7875c8" released by "delete_volume" :: held 0.821s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Created reservations ['7848f7eb-5748-4c65-ace4-855e2a74176d', '8c752412-7d7d-4557-a615-493c60760686', '5aeb120d-aec6-43e8-ba41-26f1450f57c5', 'a6471c4c-c7dc-4069-a134-15ae39cdcd4e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:43 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 1073741824" returned: 0 in 0.527s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:44 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD' failed. Not Retrying. {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 was raw, converting to qcow2 {{(pid=88915) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:44 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 Jul 31 07:41:44 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:44 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 Jul 31 07:41:44 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:44 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:44 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:44 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" returned: 0 in 0.352s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232632f0-5ffc-4798-9071-b6f6e8c3244a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded300d5-7b6e-4ccc-aad3-fe8c3efb520a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 (631bfb8b-78e9-43a1-b2c1-9cbf0d237851): created successfully Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded300d5-7b6e-4ccc-aad3-fe8c3efb520a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (704d367e-e2d9-4be7-9cc0-79fc7390f603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-55760fdc-fc3a-42c9-838c-d3e405432c07 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created volume successfully. Jul 31 07:41:44 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.446s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:44 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Deleted volume successfully. Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a594a5dc-f3ce-42d6-985a-b7fdce78ecbb tempest-VolumeDependencyTests-1583122794 None] Lock "cinder-b6e311c0-8095-490c-96fd-5e8e1c7875c8-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:44 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99" returned: 0 in 0.670s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ba6b9f5-19ec-4003-a3b6-5af278a9b503_gg_xt4undevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:41:44 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 07:41:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:44 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 1G Jul 31 07:41:44 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:45 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 1G" returned: 0 in 0.370s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Downloaded image 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'metadata': {}}])) to volume 030cfe40-52b7-4bb8-8fad-92c7b164de99 successfully. {{(pid=88915) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Temporary image 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 for user de356e2635ab40328f5a1e27b9b33f30 is deleted. {{(pid=88915) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.volume_utils [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Marking volume 030cfe40-52b7-4bb8-8fad-92c7b164de99 as bootable. {{(pid=88915) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Copying metadata from image 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 to 030cfe40-52b7-4bb8-8fad-92c7b164de99. {{(pid=88915) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Creating volume glance metadata for volume 030cfe40-52b7-4bb8-8fad-92c7b164de99 backed by image 2ba6b9f5-19ec-4003-a3b6-5af278a9b503 with: {'image_id': '2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd3b286e82932467425f5667526be2b3e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88915) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (82ed1662-dde3-42cc-8194-661cbb5ed76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56a8ce7-4a8e-46f9-a8d1-c5c0e39c86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56a8ce7-4a8e-46f9-a8d1-c5c0e39c86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581380349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec524d-8f2d-40cd-9a68-52dab2acfbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:45Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86076a57-361c-41ba-804c-2ecd616759b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86076a57-361c-41ba-804c-2ecd616759b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf06e2e-e93b-4561-95d8-78f4586dd75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf06e2e-e93b-4561-95d8-78f4586dd75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bec524d-8f2d-40cd-9a68-52dab2acfbee', 'volume_name': 'volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0d85f4-55c7-49dd-88b1-8400ae9bb01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0d85f4-55c7-49dd-88b1-8400ae9bb01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7dafa-1fdc-4d91-a898-78d91bf8cdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Volume 9bec524d-8f2d-40cd-9a68-52dab2acfbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee', 'volume_size': 1} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581380349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec524d-8f2d-40cd-9a68-52dab2acfbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:45Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Creating volume 9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:45 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:45 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee 1073741824 Jul 31 07:41:45 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244cfaf2-93fe-45dd-87ce-d3d8ad924ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030cfe40-52b7-4bb8-8fad-92c7b164de99', 'volume_size': 1, 'image_id': '2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3b286e82932467425f5667526be2b3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa111ddc57c49f1863dfe491453f2a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ea265c1210cc2fbe1cf7616672a90da6da5b67b6eee17aadd52fe3cfe72812833f6fb2f469f24a596936d8222098e69b1046d26235566ecf36175cb54167e8f', 'id': '2ba6b9f5-19ec-4003-a3b6-5af278a9b503', 'created_at': datetime.datetime(2026, 7, 31, 5, 41, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 5, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ba6b9f5-19ec-4003-a3b6-5af278a9b503/file', 'properties': {}}, 'image_service': }' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa625f5f-127a-488e-8b99-c3014a0a03e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:45 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Volume volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 (030cfe40-52b7-4bb8-8fad-92c7b164de99): created successfully Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa625f5f-127a-488e-8b99-c3014a0a03e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Flow 'volume_create_manager' (898025ec-73c1-4dbb-8384-d619abe027fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7dba53a5-71db-46b0-821e-25cbe298df2e tempest-VolumeImageDependencyTests-1425476050 None] Created volume successfully. Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:45 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee 1073741824" returned: 0 in 0.552s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:45 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee Jul 31 07:41:45 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:46 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee" returned: 0 in 0.266s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.526s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7dafa-1fdc-4d91-a898-78d91bf8cdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692210f9-e1f3-437d-b87c-2171f5683f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Creating offline snapshot daaca4f0-9b74-47f7-b676-501d061b0563 of volume 631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:41:46 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Volume volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee (9bec524d-8f2d-40cd-9a68-52dab2acfbee): created successfully Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692210f9-e1f3-437d-b87c-2171f5683f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (82ed1662-dde3-42cc-8194-661cbb5ed76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5d3833-a681-4bfc-bccb-1d90f6f573d7]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:46 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-389ec35c-becf-4f0f-87b2-fad54e2164cd tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:41:46 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 Jul 31 07:41:46 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Acquiring lock "cinder-030cfe40-52b7-4bb8-8fad-92c7b164de99-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Lock "cinder-030cfe40-52b7-4bb8-8fad-92c7b164de99-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Acquiring lock "cinder-quobyte-030cfe40-52b7-4bb8-8fad-92c7b164de99" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Lock "cinder-quobyte-030cfe40-52b7-4bb8-8fad-92c7b164de99" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f08c0-e2c2-4a63-8f44-a1c39bd513f0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:46 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 Jul 31 07:41:46 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:46 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" returned: 0 in 0.437s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:46 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 1G Jul 31 07:41:46 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:46 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99" returned: 0 in 0.388s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:46 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99 Jul 31 07:41:46 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:47 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 1G" returned: 0 in 0.497s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:47 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 Jul 31 07:41:47 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:47 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-030cfe40-52b7-4bb8-8fad-92c7b164de99" returned: 0 in 0.289s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Lock "cinder-quobyte-030cfe40-52b7-4bb8-8fad-92c7b164de99" released by "delete_volume" :: held 0.727s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Created reservations ['12666921-3644-4b1d-ba97-922ade1ba09c', '7049f024-1da7-4fb9-bd2b-f11e60d64c0e', '6b20f83b-c5d9-4769-9210-d6b2f2100aaf', 'f9c6e442-0596-4ab1-8f38-a3c498fc042a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:47 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:47 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:47 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563" returned: 0 in 0.419s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:47 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 is being set with open permissions: ugo+rw Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:47 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 Jul 31 07:41:47 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:47 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.404s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Deleted volume successfully. Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-8746ea84-354a-4988-8e25-98590196631b tempest-VolumeImageDependencyTests-1425476050 None] Lock "cinder-030cfe40-52b7-4bb8-8fad-92c7b164de99-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:48 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563" returned: 0 in 0.416s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:48 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.info Jul 31 07:41:48 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:48 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.info" returned: 0 in 0.305s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:48 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.info is being set with open permissions: ugo+rw Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:48 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.info Jul 31 07:41:48 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:48 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.info" returned: 0 in 0.283s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.845s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Creating offline snapshot 4e22ed61-9153-462b-b89d-879ffc974249 of volume 9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:41:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f4d21117-cf1f-4726-9c6f-4535e38df1d3 tempest-CreateVolumesFromSnapshotTest-458314648 None] Create snapshot completed successfully Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e68500b-4429-40a8-9d27-63f722e1504f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:48 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee Jul 31 07:41:48 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:49 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee" returned: 0 in 0.538s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:49 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 1G Jul 31 07:41:49 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (ffb5a501-e9ab-4b2f-8335-ec56aee2fb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a8ab90-0308-49ca-aff7-a9c1814ff065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a8ab90-0308-49ca-aff7-a9c1814ff065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964497500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154030d4-5520-4160-b19e-2a1cc208e9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:50Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d77d24-719e-4733-9a2e-dbc41b613c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d77d24-719e-4733-9a2e-dbc41b613c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4beaf18-8db1-4ab9-b026-adb2cd731455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4beaf18-8db1-4ab9-b026-adb2cd731455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154030d4-5520-4160-b19e-2a1cc208e9bd', 'volume_name': 'volume-154030d4-5520-4160-b19e-2a1cc208e9bd', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37c7f66-8494-4434-ae2d-4726425bd61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37c7f66-8494-4434-ae2d-4726425bd61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201bb513-52a2-453f-9efb-1f6a9109c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:49 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume 154030d4-5520-4160-b19e-2a1cc208e9bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154030d4-5520-4160-b19e-2a1cc208e9bd', 'volume_size': 1} Jul 31 07:41:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (db95910d-ef7c-4712-b736-c78d4254de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25b6998-c71b-4e2d-a05c-97e66fb339aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25b6998-c71b-4e2d-a05c-97e66fb339aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624474959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a52357-7fd4-4223-acae-1843cc3574f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:50Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f508ea20-934c-4247-9f78-6bfa70ddf61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f508ea20-934c-4247-9f78-6bfa70ddf61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5559677-c53b-4df9-b66a-b6960151e63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5559677-c53b-4df9-b66a-b6960151e63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a52357-7fd4-4223-acae-1843cc3574f0', 'volume_name': 'volume-05a52357-7fd4-4223-acae-1843cc3574f0', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38acd02-1820-46db-b938-da408333b055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38acd02-1820-46db-b938-da408333b055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7645657f-572d-49ec-8ff3-36eecc083fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume 05a52357-7fd4-4223-acae-1843cc3574f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a52357-7fd4-4223-acae-1843cc3574f0', 'volume_size': 1} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:50 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 1G" returned: 0 in 0.849s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:50 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 Jul 31 07:41:50 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (409f1206-e316-4071-b125-4b711465084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d9ac54-e54a-4c69-9e66-dd13da9644fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d9ac54-e54a-4c69-9e66-dd13da9644fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726718133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19421ba4-a57d-4883-ac67-e14aa8bb2a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:51Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51a60ba-1daf-41dd-b53c-4374e3b60eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51a60ba-1daf-41dd-b53c-4374e3b60eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbae397-b170-46aa-a9c0-76a99c72ae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbae397-b170-46aa-a9c0-76a99c72ae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19421ba4-a57d-4883-ac67-e14aa8bb2a05', 'volume_name': 'volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a7a09d-0f7a-482f-872f-3a12df80ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a7a09d-0f7a-482f-872f-3a12df80ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be52c06a-5190-49a5-b3d3-b163c40a5bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:50 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume 19421ba4-a57d-4883-ac67-e14aa8bb2a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05', 'volume_size': 1} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249" returned: 0 in 0.585s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:50 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 is being set with open permissions: ugo+rw Jul 31 07:41:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:50 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 Jul 31 07:41:50 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (07613aa8-f505-4358-b1ef-720a8ac790bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdee68b-eb40-4ffc-be81-04fb2f223120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdee68b-eb40-4ffc-be81-04fb2f223120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1712697517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b72ee03-f502-48c7-8488-18ccaa4f7946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:51Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3ce340-e102-410e-848a-c3b2feed883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3ce340-e102-410e-848a-c3b2feed883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f50deb-a490-44c1-abcd-d69e89e4399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f50deb-a490-44c1-abcd-d69e89e4399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b72ee03-f502-48c7-8488-18ccaa4f7946', 'volume_name': 'volume-8b72ee03-f502-48c7-8488-18ccaa4f7946', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe480b2-1c66-43f5-9bbf-3697a6456807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe480b2-1c66-43f5-9bbf-3697a6456807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be12fbb-c63b-4e2e-b2ac-701677a5e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume 8b72ee03-f502-48c7-8488-18ccaa4f7946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b72ee03-f502-48c7-8488-18ccaa4f7946', 'volume_size': 1} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:51 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249" returned: 0 in 0.395s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:51 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.info Jul 31 07:41:51 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (e82b0155-40e7-486a-a06c-749aade9ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb4cb79-6f51-40f8-8c6d-f2700a73cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb4cb79-6f51-40f8-8c6d-f2700a73cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459140112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8754d1c-c152-45ad-9bfb-8921804aba65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:51Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ace07d5-7002-4499-8128-594565fdf601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ace07d5-7002-4499-8128-594565fdf601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e787e8-33df-48b8-a37c-7a163aa9f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e787e8-33df-48b8-a37c-7a163aa9f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8754d1c-c152-45ad-9bfb-8921804aba65', 'volume_name': 'volume-c8754d1c-c152-45ad-9bfb-8921804aba65', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe8d5c8-9d24-4e4d-a9d5-27e08e71de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe8d5c8-9d24-4e4d-a9d5-27e08e71de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d4af28-b07b-4847-b7c4-60a79b66f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:51 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume c8754d1c-c152-45ad-9bfb-8921804aba65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8754d1c-c152-45ad-9bfb-8921804aba65', 'volume_size': 1} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.info" returned: 0 in 0.387s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:51 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.info is being set with open permissions: ugo+rw Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:51 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.info Jul 31 07:41:51 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:51 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.info" returned: 0 in 0.288s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.193s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.214s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964497500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154030d4-5520-4160-b19e-2a1cc208e9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:50Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Creating volume 154030d4-5520-4160-b19e-2a1cc208e9bd {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:51 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:51 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd 1073741824 Jul 31 07:41:51 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e4771a85-aa5c-41c5-ba16-37f8da384c7a tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-4e22ed61-9153-462b-b89d-879ffc974249-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Lock "cinder-4e22ed61-9153-462b-b89d-879ffc974249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-9bec524d-8f2d-40cd-9a68-52dab2acfbee" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9bec524d-8f2d-40cd-9a68-52dab2acfbee" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-4e22ed61-9153-462b-b89d-879ffc974249" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-4e22ed61-9153-462b-b89d-879ffc974249" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot 4e22ed61-9153-462b-b89d-879ffc974249 of volume 9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8108471c-1180-4e02-8222-e7d379bf3e48]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:52 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 Jul 31 07:41:52 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:52 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd 1073741824" returned: 0 in 0.621s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:52 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd Jul 31 07:41:52 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e1c271fd-184e-4c73-80fc-4191652e5995 tempest-ProjectAdminTests-1309104007 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540397644043, 'free_capacity_gb': 1775.7540397644043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88915) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 07:41:52 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249" returned: 0 in 0.524s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd35ce9-2e11-4253-9fc6-0d7ad5f7eb8d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:52 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd" returned: 0 in 0.315s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.755s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624474959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a52357-7fd4-4223-acae-1843cc3574f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:50Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Creating volume 05a52357-7fd4-4223-acae-1843cc3574f0 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:52 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201bb513-52a2-453f-9efb-1f6a9109c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154030d4-5520-4160-b19e-2a1cc208e9bd', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:52 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc9efda-b96d-4ddf-b95b-d23d1e65d358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:52 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 1073741824 Jul 31 07:41:52 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:53 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee Jul 31 07:41:53 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:53 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume volume-154030d4-5520-4160-b19e-2a1cc208e9bd (154030d4-5520-4160-b19e-2a1cc208e9bd): created successfully Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc9efda-b96d-4ddf-b95b-d23d1e65d358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (ffb5a501-e9ab-4b2f-8335-ec56aee2fb7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:53 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-28933aed-ad39-4f56-b950-c0a9b3b4eed0 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created volume successfully. Jul 31 07:41:53 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee" returned: 0 in 0.512s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:53 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 Jul 31 07:41:53 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:53 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 1073741824" returned: 0 in 0.636s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:53 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 Jul 31 07:41:53 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:53 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249" returned: 0 in 0.452s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:53 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249 Jul 31 07:41:53 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:53 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0" returned: 0 in 0.311s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.158s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726718133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19421ba4-a57d-4883-ac67-e14aa8bb2a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:51Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Creating volume 19421ba4-a57d-4883-ac67-e14aa8bb2a05 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:53 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:53 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7645657f-572d-49ec-8ff3-36eecc083fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a52357-7fd4-4223-acae-1843cc3574f0', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:53 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 1073741824 Jul 31 07:41:53 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c312d6-0957-4d79-8172-7bc6c9e2cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:54 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume volume-05a52357-7fd4-4223-acae-1843cc3574f0 (05a52357-7fd4-4223-acae-1843cc3574f0): created successfully Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c312d6-0957-4d79-8172-7bc6c9e2cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (db95910d-ef7c-4712-b736-c78d4254de9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8727b5ee-4973-48ba-a30b-2ed48038b5b9 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created volume successfully. Jul 31 07:41:54 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee.4e22ed61-9153-462b-b89d-879ffc974249" returned: 0 in 0.368s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-4e22ed61-9153-462b-b89d-879ffc974249" released by "_delete_snapshot" :: held 1.986s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9bec524d-8f2d-40cd-9a68-52dab2acfbee" released by "delete_snapshot" :: held 2.026s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Created reservations ['19c486c4-6485-436f-85cc-8ea6d13e7d47', 'b7925fda-be91-46ba-8242-cd8f7bf70bb0', 'd17b66c4-48cc-483f-897a-ca84b241793e', '248e401f-4283-4716-94d9-399584336fab'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6a4630a3-3984-42c8-b6b6-ea6f17983c86 tempest-ProjectMemberTests-801608708 None] Lock "cinder-4e22ed61-9153-462b-b89d-879ffc974249-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:54 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 1073741824" returned: 0 in 0.571s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:54 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 Jul 31 07:41:54 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:54 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.676s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1712697517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b72ee03-f502-48c7-8488-18ccaa4f7946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:51Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Creating volume 8b72ee03-f502-48c7-8488-18ccaa4f7946 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:54 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be52c06a-5190-49a5-b3d3-b163c40a5bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce5baf3-220b-4ff9-8ef1-7a38f128eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:54 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 1073741824 Jul 31 07:41:54 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:54 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 (19421ba4-a57d-4883-ac67-e14aa8bb2a05): created successfully Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce5baf3-220b-4ff9-8ef1-7a38f128eb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:54 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (409f1206-e316-4071-b125-4b711465084c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4856e4cf-6634-4d60-b121-d495f9d4466a tempest-CreateVolumesFromSnapshotTest-458314648 None] Created volume successfully. Jul 31 07:41:55 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 1073741824" returned: 0 in 0.526s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-9bec524d-8f2d-40cd-9a68-52dab2acfbee-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:55 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 Jul 31 07:41:55 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Lock "cinder-9bec524d-8f2d-40cd-9a68-52dab2acfbee-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-9bec524d-8f2d-40cd-9a68-52dab2acfbee" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9bec524d-8f2d-40cd-9a68-52dab2acfbee" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffb7e35-225e-4980-bba4-1230f6196e43]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:55 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee Jul 31 07:41:55 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:55 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946" returned: 0 in 0.407s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.242s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459140112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8754d1c-c152-45ad-9bfb-8921804aba65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b850b6bf4b4ed9a71dde5cc06391bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:51Z,use_quota=True,user_id='858d28ec2fcc4aea97caf2a90c112880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Creating volume c8754d1c-c152-45ad-9bfb-8921804aba65 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:55 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:55 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 1073741824 Jul 31 07:41:55 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be12fbb-c63b-4e2e-b2ac-701677a5e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b72ee03-f502-48c7-8488-18ccaa4f7946', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2e4f3f-5d35-4f9f-9144-4aea9315a020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:55 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 (8b72ee03-f502-48c7-8488-18ccaa4f7946): created successfully Jul 31 07:41:55 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2e4f3f-5d35-4f9f-9144-4aea9315a020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (07613aa8-f505-4358-b1ef-720a8ac790bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-46cfbca5-9b70-4b56-be4b-88826e7d5cf4 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created volume successfully. Jul 31 07:41:56 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee" returned: 0 in 0.602s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:56 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee Jul 31 07:41:56 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:56 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 1073741824" returned: 0 in 0.620s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:56 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9bec524d-8f2d-40cd-9a68-52dab2acfbee" returned: 0 in 0.320s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:56 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 Jul 31 07:41:56 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9bec524d-8f2d-40cd-9a68-52dab2acfbee" released by "delete_volume" :: held 1.020s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Created reservations ['29fb1eef-99ed-4942-89f8-95328022bb64', 'dc97da05-38f9-49bd-8af1-dcac27f3e745', '935244fd-a2fe-49b0-b896-c19066aa6163', 'abff862c-e235-4974-8931-fd0c903c6b47'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:56 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:56 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:56 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65" returned: 0 in 0.282s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d4af28-b07b-4847-b7c4-60a79b66f065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8754d1c-c152-45ad-9bfb-8921804aba65', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de427d67-acc1-405d-9a79-0489ebc22c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:56 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Volume volume-c8754d1c-c152-45ad-9bfb-8921804aba65 (c8754d1c-c152-45ad-9bfb-8921804aba65): created successfully Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de427d67-acc1-405d-9a79-0489ebc22c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Flow 'volume_create_manager' (e82b0155-40e7-486a-a06c-749aade9ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:56 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6db289cf-e325-4951-bb63-fafc437e2803 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created volume successfully. Jul 31 07:41:57 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.284s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:57 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-629adc9e-3a52-47ca-8b4d-ede20fa27c41 tempest-ProjectMemberTests-801608708 None] Lock "cinder-9bec524d-8f2d-40cd-9a68-52dab2acfbee-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-c8754d1c-c152-45ad-9bfb-8921804aba65-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-c8754d1c-c152-45ad-9bfb-8921804aba65-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-c8754d1c-c152-45ad-9bfb-8921804aba65" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-c8754d1c-c152-45ad-9bfb-8921804aba65" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8dc19b-ea1f-43df-9bbb-0f9b3642ec20]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:57 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 Jul 31 07:41:57 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:57 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65" returned: 0 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:57 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65 Jul 31 07:41:57 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:58 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-c8754d1c-c152-45ad-9bfb-8921804aba65" returned: 0 in 0.304s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-c8754d1c-c152-45ad-9bfb-8921804aba65" released by "delete_volume" :: held 0.774s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created reservations ['d0052bae-09fc-4ff6-816f-104d8833b3c8', '018e4c1f-dcec-45dc-a70a-1c2634ab4d8a', '4e44d6c1-f141-48f4-8339-cfdb3957729f', 'e3a9ed1a-ae22-4aeb-8e08-9e77001abc8f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:58 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:58 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-8b72ee03-f502-48c7-8488-18ccaa4f7946-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-8b72ee03-f502-48c7-8488-18ccaa4f7946-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-8b72ee03-f502-48c7-8488-18ccaa4f7946" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-8b72ee03-f502-48c7-8488-18ccaa4f7946" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6720720-4c69-4482-a882-0fb395eb2f8e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:58 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.361s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:58 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Deleted volume successfully. Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:41:58 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 Jul 31 07:41:58 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (e809fcfc-72b0-46a3-805e-26011a971792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ade17f9-3197-4131-909d-7fd03f50691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-5a49af11-b588-4f1b-9049-ba6a38130614 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-c8754d1c-c152-45ad-9bfb-8921804aba65-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ade17f9-3197-4131-909d-7fd03f50691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-431387059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bd9439-310b-4869-9cf4-645b6de2c45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:59Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3366d47c-17f5-426b-95ca-d5a4e64ac0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3366d47c-17f5-426b-95ca-d5a4e64ac0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d29d90-be0d-4734-aa39-60d006edb419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d29d90-be0d-4734-aa39-60d006edb419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87bd9439-310b-4869-9cf4-645b6de2c45e', 'volume_name': 'volume-87bd9439-310b-4869-9cf4-645b6de2c45e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65d6517-838d-4724-90a8-7d5f1e7a8352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65d6517-838d-4724-90a8-7d5f1e7a8352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43880a4-5eea-45f4-acea-c044e15e57c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:58 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Volume 87bd9439-310b-4869-9cf4-645b6de2c45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87bd9439-310b-4869-9cf4-645b6de2c45e', 'volume_size': 1} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-431387059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bd9439-310b-4869-9cf4-645b6de2c45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:41:59Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Creating volume 87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:41:58 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:41:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:58 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e 1073741824 Jul 31 07:41:58 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:59 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:59 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946 Jul 31 07:41:59 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:59 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e 1073741824" returned: 0 in 0.452s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:59 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8b72ee03-f502-48c7-8488-18ccaa4f7946" returned: 0 in 0.276s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-8b72ee03-f502-48c7-8488-18ccaa4f7946" released by "delete_volume" :: held 0.791s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:41:59 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e Jul 31 07:41:59 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Created reservations ['31d06a4f-c5bc-4032-8d59-b299abf1870b', 'cc9c20cb-5c94-454e-89ca-8314c7c9d50e', '0b8e772d-21f0-4b41-a8b9-41490bc8e36c', '9bfa91b8-c392-42ff-8895-897434dc9fa4'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:59 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:41:59 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:41:59 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e" returned: 0 in 0.335s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-19421ba4-a57d-4883-ac67-e14aa8bb2a05-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43880a4-5eea-45f4-acea-c044e15e57c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bd9439-310b-4869-9cf4-645b6de2c45e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6292ca-f354-4205-aa79-75f076d247fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-19421ba4-a57d-4883-ac67-e14aa8bb2a05-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:59 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Volume volume-87bd9439-310b-4869-9cf4-645b6de2c45e (87bd9439-310b-4869-9cf4-645b6de2c45e): created successfully Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6292ca-f354-4205-aa79-75f076d247fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (e809fcfc-72b0-46a3-805e-26011a971792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:41:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1b5e8ecd-d539-48e9-a4c5-faacf4a2ad1e tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-19421ba4-a57d-4883-ac67-e14aa8bb2a05" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-19421ba4-a57d-4883-ac67-e14aa8bb2a05" acquired by "delete_volume" :: waited 0.033s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fef01b-4ccc-43ca-8c1b-e39d99f8a515]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:41:59 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.380s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:41:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Deleted volume successfully. Jul 31 07:41:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-88d3ce5d-e2b4-48ca-902b-dc44c59784db tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-8b72ee03-f502-48c7-8488-18ccaa4f7946-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:00 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 Jul 31 07:42:00 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:00 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05" returned: 0 in 0.474s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:00 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05 Jul 31 07:42:00 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:00 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-19421ba4-a57d-4883-ac67-e14aa8bb2a05" returned: 0 in 0.296s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-19421ba4-a57d-4883-ac67-e14aa8bb2a05" released by "delete_volume" :: held 0.829s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Creating offline snapshot 9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f of volume 87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created reservations ['a2ad1526-8b58-462a-ba3e-a7e0e78f4543', 'cc841b1d-64bc-4f3d-aab0-80e6458eac73', '00d3a0ca-fb32-4a23-b354-763c10e47081', '244f93e0-e43c-4993-adac-f7a3f99ce4af'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e94df7-e0a1-45f3-92a4-660051f987e7]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:00 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:00 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:01 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e Jul 31 07:42:01 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:01 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.304s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:01 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:01 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Deleted volume successfully. Jul 31 07:42:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4ffb3f7d-d1bf-4858-a7e1-19118393ebf8 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-19421ba4-a57d-4883-ac67-e14aa8bb2a05-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:01 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e" returned: 0 in 0.579s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:01 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f 1G Jul 31 07:42:01 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:01 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f 1G" returned: 0 in 0.486s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bd9439-310b-4869-9cf4-645b6de2c45e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:01 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bd9439-310b-4869-9cf4-645b6de2c45e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f Jul 31 07:42:01 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-05a52357-7fd4-4223-acae-1843cc3574f0-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-05a52357-7fd4-4223-acae-1843cc3574f0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-05a52357-7fd4-4223-acae-1843cc3574f0" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-05a52357-7fd4-4223-acae-1843cc3574f0" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c221c6-ffd9-4aed-aede-50e391fc0b9f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:02 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bd9439-310b-4869-9cf4-645b6de2c45e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" returned: 0 in 0.368s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:02 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f is being set with open permissions: ugo+rw Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:02 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f Jul 31 07:42:02 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:02 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 Jul 31 07:42:02 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:02 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" returned: 0 in 0.302s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:02 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0" returned: 0 in 0.412s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:02 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.info Jul 31 07:42:02 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:02 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0 Jul 31 07:42:02 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:02 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.info" returned: 0 in 0.298s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:02 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.info is being set with open permissions: ugo+rw Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:02 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.info Jul 31 07:42:02 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:02 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-05a52357-7fd4-4223-acae-1843cc3574f0" returned: 0 in 0.345s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-05a52357-7fd4-4223-acae-1843cc3574f0" released by "delete_volume" :: held 0.813s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Created reservations ['9b6415b6-f755-4fa5-b9f5-67288a4f7961', 'd2252af9-7480-4724-97bb-79dccbde1cbc', '756794f5-a6e0-4de3-b8ba-5a52f1d278c8', '1b6e9c7e-8c61-4157-96fb-661fc8cca1b5'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:03 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:03 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-154030d4-5520-4160-b19e-2a1cc208e9bd-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:03 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.info" returned: 0 in 0.397s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-154030d4-5520-4160-b19e-2a1cc208e9bd-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f9d30edc-bdb5-453a-adde-d9ab7e159185 tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-154030d4-5520-4160-b19e-2a1cc208e9bd" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-154030d4-5520-4160-b19e-2a1cc208e9bd" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8f012-a154-449c-bd24-d9e9862d49a0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:03 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Deleted volume successfully. Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-4c82a3a6-9150-4a66-93af-ebb38e51867c tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-05a52357-7fd4-4223-acae-1843cc3574f0-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:03 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd Jul 31 07:42:03 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (53180fea-9d59-43f4-a3ba-17795cc706aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ad0101-3137-4ac6-a46c-33f43339c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ad0101-3137-4ac6-a46c-33f43339c087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215744244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:04Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3051d08d-e020-4e30-ba57-6b26a4f69e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3051d08d-e020-4e30-ba57-6b26a4f69e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f3e557-fea8-4ce9-aea8-73287f502662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f3e557-fea8-4ce9-aea8-73287f502662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3', 'volume_name': 'volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45408804-c17b-4f34-8e49-f889455d7447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45408804-c17b-4f34-8e49-f889455d7447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b2f40d-5b66-45b2-8ab3-5c1f700816a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:03 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Volume 2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3', 'volume_size': 1} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215744244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:04Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Creating volume 2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:03 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:03 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:03 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 1073741824 Jul 31 07:42:03 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd" returned: 0 in 0.434s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:03 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Lock "cinder-9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:03 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-87bd9439-310b-4869-9cf4-645b6de2c45e" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-87bd9439-310b-4869-9cf4-645b6de2c45e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot 9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f of volume 87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ce053-a179-4fd2-b38a-cf65dcd581d3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:04 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f Jul 31 07:42:04 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:04 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-154030d4-5520-4160-b19e-2a1cc208e9bd" returned: 0 in 0.318s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-154030d4-5520-4160-b19e-2a1cc208e9bd" released by "delete_volume" :: held 0.812s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Created reservations ['a9220d4e-b8ea-4028-a12e-920311b0827b', '86c54de2-de47-416e-9c67-9affd2d16852', '3c051482-e4cb-46eb-a8cd-551be3a61ed7', '8c63c760-187a-4bb0-944d-9560cc359a9f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:04 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:04 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:04 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 1073741824" returned: 0 in 0.587s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:04 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-daaca4f0-9b74-47f7-b676-501d061b0563-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:04 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" returned: 0 in 0.495s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87bd9439-310b-4869-9cf4-645b6de2c45e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:04 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d93970-f534-4870-916f-a2a0bd7229c6]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-daaca4f0-9b74-47f7-b676-501d061b0563-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-daaca4f0-9b74-47f7-b676-501d061b0563" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-daaca4f0-9b74-47f7-b676-501d061b0563" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Deleting offline snapshot daaca4f0-9b74-47f7-b676-501d061b0563 of volume 631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:04 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] snapshot_file for this snap is: volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.350s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Deleted volume successfully. Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7121ac9c-ed43-48bd-ab40-1e8d4e9404e3]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:04 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e Jul 31 07:42:04 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-aa2853ae-c2c7-47f5-b936-762838af7ecd tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-154030d4-5520-4160-b19e-2a1cc208e9bd-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:04 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" returned: 0 in 0.399s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b2f40d-5b66-45b2-8ab3-5c1f700816a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d2467d-4da1-4470-b778-406bf7bc5f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:04 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 Jul 31 07:42:04 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:04 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Volume volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 (2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3): created successfully Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d2467d-4da1-4470-b778-406bf7bc5f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (53180fea-9d59-43f4-a3ba-17795cc706aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:04 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Flow 'volume_create_manager' (6b8bb26c-74d8-4c78-b19a-586923dcd697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bfc69c-4b54-400e-a980-6432a7af4553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7ca3cca6-8164-4713-9354-ca5afc533595 tempest-ProjectReaderTests-762434769 None] Created volume successfully. Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bfc69c-4b54-400e-a980-6432a7af4553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649450804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069bb10-646c-4bff-aa9c-5f02d03005d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbec313d2b64082bbb038d158e61de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:05Z,use_quota=True,user_id='75d8491aabd84315b8de7698c191f8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b7ee72-14c2-4507-88bd-64607e9f7b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b7ee72-14c2-4507-88bd-64607e9f7b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c04a2d6-e209-4ef0-b810-5e70ef9051ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c04a2d6-e209-4ef0-b810-5e70ef9051ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2069bb10-646c-4bff-aa9c-5f02d03005d4', 'volume_name': 'volume-2069bb10-646c-4bff-aa9c-5f02d03005d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376be24-9cba-44b6-bb71-4238c29ec10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376be24-9cba-44b6-bb71-4238c29ec10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45dfab1-f557-43a6-a1fe-1012a6f46aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Volume 2069bb10-646c-4bff-aa9c-5f02d03005d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2069bb10-646c-4bff-aa9c-5f02d03005d4', 'volume_size': 1} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649450804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069bb10-646c-4bff-aa9c-5f02d03005d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbec313d2b64082bbb038d158e61de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:05Z,use_quota=True,user_id='75d8491aabd84315b8de7698c191f8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Creating volume 2069bb10-646c-4bff-aa9c-5f02d03005d4 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:05 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:05 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 1073741824 Jul 31 07:42:05 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:05 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e" returned: 0 in 0.561s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:05 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f Jul 31 07:42:05 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:05 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563" returned: 0 in 0.443s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da9a33-dfab-4a1f-8482-100595d54083]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:05 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 Jul 31 07:42:05 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:05 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" returned: 0 in 0.358s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:05 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 1073741824" returned: 0 in 0.461s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:05 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f Jul 31 07:42:05 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:05 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 Jul 31 07:42:05 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:05 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" returned: 0 in 0.419s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:05 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 Jul 31 07:42:05 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:05 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e.9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" returned: 0 in 0.268s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:05 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f" released by "_delete_snapshot" :: held 1.836s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4" returned: 0 in 0.284s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-87bd9439-310b-4869-9cf4-645b6de2c45e" released by "delete_snapshot" :: held 1.868s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45dfab1-f557-43a6-a1fe-1012a6f46aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2069bb10-646c-4bff-aa9c-5f02d03005d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05accd1-79ee-4ba8-9846-1d9324e985e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:05 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Volume volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 (2069bb10-646c-4bff-aa9c-5f02d03005d4): created successfully Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05accd1-79ee-4ba8-9846-1d9324e985e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Flow 'volume_create_manager' (6b8bb26c-74d8-4c78-b19a-586923dcd697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:05 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5f16fc3e-1cf9-4001-9f58-7ff28461d1af tempest-ProjectReaderTests-821561163 None] Created volume successfully. Jul 31 07:42:05 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Created reservations ['eaf48a9c-0906-43d1-9b3b-f348258c4fd9', 'c7e1e13c-4e7e-43d9-8b26-d5741e378398', '1fe580c7-a534-417d-aaa8-f626b57b205f', 'ea469ed2-fc83-48b4-931f-953a8c8e6052'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1630a98a-2a93-43cd-8f90-9c83da717247 tempest-ProjectMemberTests-801608708 None] Lock "cinder-9450cd9e-7a42-4f15-b5a2-b7aec9f56b9f-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:06 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563" returned: 0 in 0.430s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Creating offline snapshot 6006dba2-4f08-453f-bb0d-991b8edd7a1d of volume 2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac582d9e-88f2-45e3-9bcf-81561aee6002]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:06 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563 Jul 31 07:42:06 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-87bd9439-310b-4869-9cf4-645b6de2c45e-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Lock "cinder-87bd9439-310b-4869-9cf4-645b6de2c45e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:06 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=196,cinder:UPDATE=267,cinder:INSERT=76,cinder:DELETE=30 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:42:06 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-87bd9439-310b-4869-9cf4-645b6de2c45e" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-87bd9439-310b-4869-9cf4-645b6de2c45e" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[88035afc-3b64-449c-890c-18c60de9add8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:06 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851.daaca4f0-9b74-47f7-b676-501d061b0563" returned: 0 in 0.362s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:UPDATE=271,cinder:SELECT=203,cinder:INSERT=67,cinder:DELETE=20 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-daaca4f0-9b74-47f7-b676-501d061b0563" released by "_delete_snapshot" :: held 1.835s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" released by "delete_snapshot" :: held 1.878s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created reservations ['c267ca73-13e3-42ef-a413-9d24a27875d9', '856fd22f-1bd4-4a01-a587-51140ceb36ce', 'dbaf48b4-ddf4-4719-a0ef-f7736f2df2c2', '852ecc78-0382-4264-9ea9-e7474fa40b8e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:06 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e Jul 31 07:42:06 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:06 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" returned: 0 in 0.491s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:06 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d 1G Jul 31 07:42:06 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:06 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Delete snapshot completed successfully. Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c6b8d17d-2736-4a2b-915d-ae7ed23f19b2 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-daaca4f0-9b74-47f7-b676-501d061b0563-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-631bfb8b-78e9-43a1-b2c1-9cbf0d237851-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-631bfb8b-78e9-43a1-b2c1-9cbf0d237851-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "cinder-quobyte-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[50985865-6f6f-44b0-9e14-bacb6ec0aad9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:06 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e" returned: 0 in 0.441s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:06 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e Jul 31 07:42:06 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 Jul 31 07:42:07 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d 1G" returned: 0 in 0.518s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d Jul 31 07:42:07 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-87bd9439-310b-4869-9cf4-645b6de2c45e" returned: 0 in 0.338s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-87bd9439-310b-4869-9cf4-645b6de2c45e" released by "delete_volume" :: held 0.847s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Acquiring lock "cinder-2069bb10-646c-4bff-aa9c-5f02d03005d4-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Lock "cinder-2069bb10-646c-4bff-aa9c-5f02d03005d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:07 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" returned: 0 in 0.497s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Acquiring lock "cinder-quobyte-2069bb10-646c-4bff-aa9c-5f02d03005d4" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Created reservations ['a08674cf-6404-4eb2-8694-dc4bb80b221e', 'aa537bda-b3c9-45ca-afed-a2a7f559ce4c', '4bb5b000-2d29-4728-8fb0-00d0795e6441', 'af45fd10-3981-4d24-b830-53898beaa996'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:07 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851 Jul 31 07:42:07 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Lock "cinder-quobyte-2069bb10-646c-4bff-aa9c-5f02d03005d4" acquired by "delete_volume" :: waited 0.041s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[28755da7-b70b-447a-aa2f-8c20edbc3c6c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d" returned: 0 in 0.362s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d is being set with open permissions: ugo+rw Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d Jul 31 07:42:07 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:07 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 Jul 31 07:42:07 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" returned: 0 in 0.303s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-quobyte-631bfb8b-78e9-43a1-b2c1-9cbf0d237851" released by "delete_volume" :: held 0.890s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Created reservations ['7eeb3420-3930-40d5-8029-404534bf1593', '48308367-9e6c-4c3f-8428-8ef56f7b1dfa', '993e623a-7d07-4a81-a4ea-910fbad30e51', '4bb3ce13-1c5d-4e19-9382-e2304fe01821'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:07 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d" returned: 0 in 0.274s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.293s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:07 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:42:07 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.info Jul 31 07:42:07 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-63f41c7d-113c-43d1-bbce-23eef6d9dba6 tempest-ProjectMemberTests-801608708 None] Lock "cinder-87bd9439-310b-4869-9cf4-645b6de2c45e-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:07 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:07 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4" returned: 0 in 0.483s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:07 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4 Jul 31 07:42:07 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:08 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.info" returned: 0 in 0.310s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:08 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.info is being set with open permissions: ugo+rw Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:08 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.info Jul 31 07:42:08 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:08 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Deleted volume successfully. Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6aa46faf-7ab1-4b13-bc7e-883df39d4e19 tempest-CreateVolumesFromSnapshotTest-458314648 None] Lock "cinder-631bfb8b-78e9-43a1-b2c1-9cbf0d237851-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:08 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2069bb10-646c-4bff-aa9c-5f02d03005d4" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Lock "cinder-quobyte-2069bb10-646c-4bff-aa9c-5f02d03005d4" released by "delete_volume" :: held 0.854s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Created reservations ['74f23f74-56c9-4207-b358-da30bceda711', '22452ca9-3fc9-4062-a772-c6775163f5bf', '822ef462-45cf-49bb-b30a-9fa8896a0455', 'dc3b53ac-8bb9-47f9-81ef-bd821ae95a05'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:08 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.info" returned: 0 in 0.313s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:08 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:08 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cd9bc1e9-6e2e-4fd1-a5ac-e824a034a51c tempest-ProjectReaderTests-762434769 None] Create snapshot completed successfully Jul 31 07:42:08 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.337s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:08 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Deleted volume successfully. Jul 31 07:42:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-eb1b8cfd-312b-44b1-8e12-0a4214d5a45f tempest-ProjectReaderTests-821561163 None] Lock "cinder-2069bb10-646c-4bff-aa9c-5f02d03005d4-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Flow 'volume_create_manager' (e41bf214-2a34-41c1-ba10-e72687148b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dddbd32-9d15-488e-b23c-30b8f019fd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dddbd32-9d15-488e-b23c-30b8f019fd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796652248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d541ccd3-9555-453d-9e11-32516f315db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbec313d2b64082bbb038d158e61de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:09Z,use_quota=True,user_id='75d8491aabd84315b8de7698c191f8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b1a3de-79be-4037-9c22-6928ee47d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b1a3de-79be-4037-9c22-6928ee47d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ad5951-dce7-4400-b640-fee92d0275b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ad5951-dce7-4400-b640-fee92d0275b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd541ccd3-9555-453d-9e11-32516f315db2', 'volume_name': 'volume-d541ccd3-9555-453d-9e11-32516f315db2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f62789-acad-49ce-9284-5ec2cfaceed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f62789-acad-49ce-9284-5ec2cfaceed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4369bca-751e-4d56-b3e8-40f0a7945713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Volume d541ccd3-9555-453d-9e11-32516f315db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d541ccd3-9555-453d-9e11-32516f315db2', 'volume_size': 1} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796652248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d541ccd3-9555-453d-9e11-32516f315db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbec313d2b64082bbb038d158e61de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:09Z,use_quota=True,user_id='75d8491aabd84315b8de7698c191f8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Creating volume d541ccd3-9555-453d-9e11-32516f315db2 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:09 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:09 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 1073741824 Jul 31 07:42:09 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (b7ac3f78-4692-40f5-988b-093e7880e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfac8e2-9c59-4bfb-8b4b-cc66e00ae722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfac8e2-9c59-4bfb-8b4b-cc66e00ae722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064553911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791a13d2-d0fe-437f-8a88-704a2954039d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:09Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea06a953-fdf6-4f81-a708-37888bee66ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea06a953-fdf6-4f81-a708-37888bee66ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c9272-648b-48e6-b78f-bc0ceb3c1422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c9272-648b-48e6-b78f-bc0ceb3c1422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791a13d2-d0fe-437f-8a88-704a2954039d', 'volume_name': 'volume-791a13d2-d0fe-437f-8a88-704a2954039d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3225009f-4f67-42d9-b451-f606f65750ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3225009f-4f67-42d9-b451-f606f65750ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e5d58c-0b6e-4ef0-afaf-af4b28dd14ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:09 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Volume 791a13d2-d0fe-437f-8a88-704a2954039d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791a13d2-d0fe-437f-8a88-704a2954039d', 'volume_size': 1} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-6006dba2-4f08-453f-bb0d-991b8edd7a1d-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Lock "cinder-6006dba2-4f08-453f-bb0d-991b8edd7a1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-6006dba2-4f08-453f-bb0d-991b8edd7a1d" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-6006dba2-4f08-453f-bb0d-991b8edd7a1d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Deleting offline snapshot 6006dba2-4f08-453f-bb0d-991b8edd7a1d of volume 2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] snapshot_file for this snap is: volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ca826d-3887-4ea4-ba3a-df7cf8015d43]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:09 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d Jul 31 07:42:09 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:09 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 1073741824" returned: 0 in 0.559s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:09 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 Jul 31 07:42:09 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:10 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d" returned: 0 in 0.425s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:10 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffb1bb8-2360-4a47-b940-acc6cf50aeb5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2" returned: 0 in 0.289s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064553911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791a13d2-d0fe-437f-8a88-704a2954039d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:09Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Creating volume 791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:10 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4369bca-751e-4d56-b3e8-40f0a7945713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d541ccd3-9555-453d-9e11-32516f315db2', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:10 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d 1073741824 Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d54143a-87f0-4eee-b23f-3ffa41368820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:10 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Volume volume-d541ccd3-9555-453d-9e11-32516f315db2 (d541ccd3-9555-453d-9e11-32516f315db2): created successfully Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d54143a-87f0-4eee-b23f-3ffa41368820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Flow 'volume_create_manager' (e41bf214-2a34-41c1-ba10-e72687148b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:10 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7533f43d-4027-436c-9736-aeb38e6be569 tempest-ProjectReaderTests-821561163 None] Created volume successfully. Jul 31 07:42:10 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 Jul 31 07:42:10 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:10 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" returned: 0 in 0.383s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:10 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d Jul 31 07:42:10 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:10 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d 1073741824" returned: 0 in 0.462s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:10 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d Jul 31 07:42:10 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:10 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d" returned: 0 in 0.381s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:10 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d Jul 31 07:42:10 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:10 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e5d58c-0b6e-4ef0-afaf-af4b28dd14ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791a13d2-d0fe-437f-8a88-704a2954039d', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbadf26-2e3a-4717-b695-532a2fe95e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:10 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Volume volume-791a13d2-d0fe-437f-8a88-704a2954039d (791a13d2-d0fe-437f-8a88-704a2954039d): created successfully Jul 31 07:42:10 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbadf26-2e3a-4717-b695-532a2fe95e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (b7ac3f78-4692-40f5-988b-093e7880e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-47deb0cb-4c9d-45ab-b797-5bee6b67efdd tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:42:11 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3.6006dba2-4f08-453f-bb0d-991b8edd7a1d" returned: 0 in 0.300s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Acquiring lock "cinder-d541ccd3-9555-453d-9e11-32516f315db2-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-6006dba2-4f08-453f-bb0d-991b8edd7a1d" released by "_delete_snapshot" :: held 1.631s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Lock "cinder-d541ccd3-9555-453d-9e11-32516f315db2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" released by "delete_snapshot" :: held 1.679s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Flow 'volume_create_manager' (6d27bc40-6a64-4731-ab23-65de89c4e50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adf4d0d-ba1c-4d20-ab7e-0e46c5e7f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adf4d0d-ba1c-4d20-ab7e-0e46c5e7f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850526dd-4c11-4ac6-99cb-945fa8a87dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062b3ed720a4d599a673977822a40af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:11Z,use_quota=True,user_id='99d2536faa8a47d09df45e796c6f138e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0da0049-9dad-4309-a965-24639796da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0da0049-9dad-4309-a965-24639796da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ad6768-e6a0-40f4-9b84-49c39f785875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ad6768-e6a0-40f4-9b84-49c39f785875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850526dd-4c11-4ac6-99cb-945fa8a87dab', 'volume_name': 'volume-850526dd-4c11-4ac6-99cb-945fa8a87dab', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c915dda6-9fae-4ed8-b27b-aea75573cea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c915dda6-9fae-4ed8-b27b-aea75573cea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db8c5fd-c78d-4969-899c-7ccad86eb3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:11 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Volume 850526dd-4c11-4ac6-99cb-945fa8a87dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850526dd-4c11-4ac6-99cb-945fa8a87dab', 'volume_size': 1} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850526dd-4c11-4ac6-99cb-945fa8a87dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062b3ed720a4d599a673977822a40af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:11Z,use_quota=True,user_id='99d2536faa8a47d09df45e796c6f138e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Creating volume 850526dd-4c11-4ac6-99cb-945fa8a87dab {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:11 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Acquiring lock "cinder-quobyte-d541ccd3-9555-453d-9e11-32516f315db2" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:11 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab 1073741824 Jul 31 07:42:11 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Lock "cinder-quobyte-d541ccd3-9555-453d-9e11-32516f315db2" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4b7400-3522-4217-89b9-8a156e6a4d91]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Created reservations ['d0d69564-3016-4cf8-8352-2988efde57ed', 'a698ec9d-ac56-4bb0-8511-cb21da64baa6', '95cee9ea-2e98-4da7-8085-846cc3c44624', '63c5841f-1627-40c0-92f2-14adf9cc01ac'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Delete snapshot completed successfully. Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-e5a1bc23-ca9b-4fdd-84fe-e04e07c02f4b tempest-ProjectReaderTests-762434769 None] Lock "cinder-6006dba2-4f08-453f-bb0d-991b8edd7a1d-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:11 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 Jul 31 07:42:11 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Lock "cinder-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b0bf6b-e62b-4481-9f69-0597f4c24cbe]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:11 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2" returned: 0 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:11 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab 1073741824" returned: 0 in 0.514s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:11 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2 Jul 31 07:42:11 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:12 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 Jul 31 07:42:12 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:12 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab Jul 31 07:42:12 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:12 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-d541ccd3-9555-453d-9e11-32516f315db2" returned: 0 in 0.264s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Lock "cinder-quobyte-d541ccd3-9555-453d-9e11-32516f315db2" released by "delete_volume" :: held 0.735s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:12 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab" returned: 0 in 0.261s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.714s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Created reservations ['be7eeade-e754-4fa5-91cb-5033524b1e21', 'c6bc961d-3e98-42a0-8e92-0b9899b9b93d', '0f343a60-e9a4-491f-9de6-8fb5d832da75', '24261c0c-42c8-4cbe-a657-f1d914c317e0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db8c5fd-c78d-4969-899c-7ccad86eb3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850526dd-4c11-4ac6-99cb-945fa8a87dab', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:12 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1b4a4f-a0b8-4803-a0cd-8e1f58782254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Creating offline snapshot e041c508-4f29-4c89-82b2-fe3a29467bb6 of volume 791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" returned: 0 in 0.422s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26e55fd-5ca6-45ab-8125-aa60ce4daa3a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:12 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3 Jul 31 07:42:12 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:12 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Volume volume-850526dd-4c11-4ac6-99cb-945fa8a87dab (850526dd-4c11-4ac6-99cb-945fa8a87dab): created successfully Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1b4a4f-a0b8-4803-a0cd-8e1f58782254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Flow 'volume_create_manager' (6d27bc40-6a64-4731-ab23-65de89c4e50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-981d0962-6c72-4817-beb4-9d1d43faf29a tempest-CinderUnicodeTest-1058144228 None] Created volume successfully. Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:12 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d Jul 31 07:42:12 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:12 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:12 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:12 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" returned: 0 in 0.284s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3" released by "delete_volume" :: held 0.776s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Created reservations ['793b1766-9c03-4c81-b081-9835064d4c42', 'baaa0f7b-32a2-4ed8-9ce1-b4102bb719f9', '5a76ddc2-05c4-40af-ab81-9915d7a41fac', 'f7fc1b56-3e98-45ae-a89f-825b8cfb6677'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:12 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.259s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:12 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Deleted volume successfully. Jul 31 07:42:12 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d" returned: 0 in 0.397s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bfb518dd-7b8a-48ff-851c-cb34b6b1ff59 tempest-ProjectReaderTests-821561163 None] Lock "cinder-d541ccd3-9555-453d-9e11-32516f315db2-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:12 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 1G Jul 31 07:42:12 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:12 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:12 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:12 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:13 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.269s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:13 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Deleted volume successfully. Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-f9c6f020-dbc1-45eb-83f4-9843bc1b70c1 tempest-ProjectReaderTests-762434769 None] Lock "cinder-2dc4b9f1-b4cb-4ca2-af7a-78bb4ac108a3-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:13 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 1G" returned: 0 in 0.452s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791a13d2-d0fe-437f-8a88-704a2954039d -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:13 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791a13d2-d0fe-437f-8a88-704a2954039d -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 Jul 31 07:42:13 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (6b7a1d9b-0bf1-4ebb-901d-55cfabfa0237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:13 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4003464-4d96-41a1-b3d0-eb6b627ee44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791a13d2-d0fe-437f-8a88-704a2954039d -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:13 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 is being set with open permissions: ugo+rw Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4003464-4d96-41a1-b3d0-eb6b627ee44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048162251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599ef576-28e3-417c-85a7-d0b716805a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:13Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:13 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 Jul 31 07:42:13 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc622afe-4930-4ac5-9ae7-048a0ad6cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc622afe-4930-4ac5-9ae7-048a0ad6cc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a7945d-b17d-4e3a-b2be-ae986780f8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a7945d-b17d-4e3a-b2be-ae986780f8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599ef576-28e3-417c-85a7-d0b716805a48', 'volume_name': 'volume-599ef576-28e3-417c-85a7-d0b716805a48', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175c2154-086c-4b85-8385-542b22aed047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175c2154-086c-4b85-8385-542b22aed047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5042d0-7af0-4d35-ad7a-9bd6d892ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:13 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Volume 599ef576-28e3-417c-85a7-d0b716805a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599ef576-28e3-417c-85a7-d0b716805a48', 'volume_size': 1} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:13 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6" returned: 0 in 0.304s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:13 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.info Jul 31 07:42:13 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Flow 'volume_create_manager' (2086d65e-1644-4244-ae46-19d83a9e5793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4949293-1d82-4eb4-b0e8-51d3f9901ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4949293-1d82-4eb4-b0e8-51d3f9901ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-647463511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5cb8dd-58db-495d-a9cb-5d243967500e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062b3ed720a4d599a673977822a40af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:14Z,use_quota=True,user_id='99d2536faa8a47d09df45e796c6f138e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c887814e-55db-4d15-8a7e-4fac894894b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c887814e-55db-4d15-8a7e-4fac894894b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d095a44e-3bab-4a34-b2cd-9bb4fea8fb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d095a44e-3bab-4a34-b2cd-9bb4fea8fb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f5cb8dd-58db-495d-a9cb-5d243967500e', 'volume_name': 'volume-7f5cb8dd-58db-495d-a9cb-5d243967500e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72d60b7-43a5-4dcc-96ec-6b5e95d26068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72d60b7-43a5-4dcc-96ec-6b5e95d26068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e0aa1a-50c1-4fce-8a33-b31748278c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Volume 7f5cb8dd-58db-495d-a9cb-5d243967500e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f5cb8dd-58db-495d-a9cb-5d243967500e', 'volume_size': 1} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:14 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.info" returned: 0 in 0.298s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:14 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.info is being set with open permissions: ugo+rw Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:14 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.info Jul 31 07:42:14 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:14 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.info" returned: 0 in 0.261s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048162251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599ef576-28e3-417c-85a7-d0b716805a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:13Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Creating volume 599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:14 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:14 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 1073741824 Jul 31 07:42:14 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-65bc8bb2-a009-4d6d-b889-224328b655d8 tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-e041c508-4f29-4c89-82b2-fe3a29467bb6-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Lock "cinder-e041c508-4f29-4c89-82b2-fe3a29467bb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-791a13d2-d0fe-437f-8a88-704a2954039d" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-791a13d2-d0fe-437f-8a88-704a2954039d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-e041c508-4f29-4c89-82b2-fe3a29467bb6" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-e041c508-4f29-4c89-82b2-fe3a29467bb6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot e041c508-4f29-4c89-82b2-fe3a29467bb6 of volume 791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e9c1b9-89f3-449a-b4c8-1da3f97d816e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:14 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 Jul 31 07:42:14 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:15 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 1073741824" returned: 0 in 0.518s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:15 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 Jul 31 07:42:15 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:15 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6" returned: 0 in 0.414s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-791a13d2-d0fe-437f-8a88-704a2954039d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dabfd89-652a-4e66-8705-df1db4ac1ac9]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:15 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48" returned: 0 in 0.293s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-647463511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5cb8dd-58db-495d-a9cb-5d243967500e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062b3ed720a4d599a673977822a40af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:14Z,use_quota=True,user_id='99d2536faa8a47d09df45e796c6f138e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Creating volume 7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:15 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:15 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d Jul 31 07:42:15 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:15 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e 1073741824 Jul 31 07:42:15 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5042d0-7af0-4d35-ad7a-9bd6d892ee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599ef576-28e3-417c-85a7-d0b716805a48', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53135904-dba6-4f52-a131-8b1f35099a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:15 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Volume volume-599ef576-28e3-417c-85a7-d0b716805a48 (599ef576-28e3-417c-85a7-d0b716805a48): created successfully Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53135904-dba6-4f52-a131-8b1f35099a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (6b7a1d9b-0bf1-4ebb-901d-55cfabfa0237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:15 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-aef6c10f-e8c7-4a06-a0e5-c8a6f8e7855d tempest-ProjectReaderTests-762434769 None] Created volume successfully. Jul 31 07:42:15 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d" returned: 0 in 0.477s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:15 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 Jul 31 07:42:15 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:15 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e 1073741824" returned: 0 in 0.553s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:16 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e Jul 31 07:42:16 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:16 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6" returned: 0 in 0.411s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:16 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6 Jul 31 07:42:16 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:16 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.464s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e0aa1a-50c1-4fce-8a33-b31748278c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f5cb8dd-58db-495d-a9cb-5d243967500e', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e70b36-eb99-417c-94aa-edca43f82389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Creating offline snapshot 411b55de-ed22-42e0-894b-c654b84ea038 of volume 599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:16 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Volume volume-7f5cb8dd-58db-495d-a9cb-5d243967500e (7f5cb8dd-58db-495d-a9cb-5d243967500e): created successfully Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e70b36-eb99-417c-94aa-edca43f82389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Flow 'volume_create_manager' (2086d65e-1644-4244-ae46-19d83a9e5793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5671b459-29c4-4130-9c9f-39faf26e5a20]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-58206f88-70e4-48d2-a98f-26c645a2c07d tempest-CinderUnicodeTest-1058144228 None] Created volume successfully. Jul 31 07:42:16 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d.e041c508-4f29-4c89-82b2-fe3a29467bb6" returned: 0 in 0.299s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:16 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 Jul 31 07:42:16 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-e041c508-4f29-4c89-82b2-fe3a29467bb6" released by "_delete_snapshot" :: held 1.701s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-791a13d2-d0fe-437f-8a88-704a2954039d" released by "delete_snapshot" :: held 1.726s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Created reservations ['27596b95-99f9-483a-bd80-ad2cccf258cf', 'bd574cf4-444d-44e6-ac7b-17e761458e25', 'fd36f408-4972-4724-ab8e-f81301544f83', '3469fb4d-1ebc-457f-9d5d-c1304ded3b60'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-7e06290f-3463-47bc-a345-f6e5d2dd9782 tempest-ProjectMemberTests-801608708 None] Lock "cinder-e041c508-4f29-4c89-82b2-fe3a29467bb6-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:16 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48" returned: 0 in 0.425s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:16 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 1G Jul 31 07:42:16 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-791a13d2-d0fe-437f-8a88-704a2954039d-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:16 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Lock "cinder-791a13d2-d0fe-437f-8a88-704a2954039d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-791a13d2-d0fe-437f-8a88-704a2954039d" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-791a13d2-d0fe-437f-8a88-704a2954039d" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7527274c-bd0f-4210-aa9c-69f050002316]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:17 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d Jul 31 07:42:17 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:17 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 1G" returned: 0 in 0.574s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599ef576-28e3-417c-85a7-d0b716805a48 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:17 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599ef576-28e3-417c-85a7-d0b716805a48 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 Jul 31 07:42:17 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:17 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d" returned: 0 in 0.491s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:17 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d Jul 31 07:42:17 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:17 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599ef576-28e3-417c-85a7-d0b716805a48 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038" returned: 0 in 0.408s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:17 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 is being set with open permissions: ugo+rw Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:17 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 Jul 31 07:42:17 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:17 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-791a13d2-d0fe-437f-8a88-704a2954039d" returned: 0 in 0.314s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-791a13d2-d0fe-437f-8a88-704a2954039d" released by "delete_volume" :: held 0.888s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Created reservations ['01276754-eebd-4320-a6b1-291813b894ce', '0eccff08-1bfc-45a8-b630-8ae3d3f48b2a', 'a45d89ed-5bc3-465d-a733-91b962c125ca', 'b7530808-ca96-429e-8fdd-96393bbf80ab'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:18 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038" returned: 0 in 0.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:18 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.info Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:18 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:18 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:18 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:18 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.info" returned: 0 in 0.302s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:18 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.info is being set with open permissions: ugo+rw Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:18 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.295s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:42:18 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.info Jul 31 07:42:18 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-04468985-4c4d-4a74-9176-6c3fba961d73 tempest-ProjectMemberTests-801608708 None] Lock "cinder-791a13d2-d0fe-437f-8a88-704a2954039d-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:18 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.info" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.255s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Creating offline snapshot 0092b7c4-b2d6-4a80-8386-442aaa2c8b03 of volume 7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:18 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3c4a0a6e-0106-4cd8-9d61-df62b160060f tempest-ProjectReaderTests-762434769 None] Create snapshot completed successfully Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[b855090b-edc6-4bd0-8fb8-62c2930d7f2a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:18 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e Jul 31 07:42:18 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:18 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-411b55de-ed22-42e0-894b-c654b84ea038-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Lock "cinder-411b55de-ed22-42e0-894b-c654b84ea038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-599ef576-28e3-417c-85a7-d0b716805a48" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-599ef576-28e3-417c-85a7-d0b716805a48" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-411b55de-ed22-42e0-894b-c654b84ea038" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-411b55de-ed22-42e0-894b-c654b84ea038" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Deleting offline snapshot 411b55de-ed22-42e0-894b-c654b84ea038 of volume 599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] snapshot_file for this snap is: volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba9253-3750-4e4b-9856-ea4c30217978]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:19 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 Jul 31 07:42:19 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:19 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e" returned: 0 in 0.500s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:19 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 1G Jul 31 07:42:19 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:19 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038" returned: 0 in 0.551s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-599ef576-28e3-417c-85a7-d0b716805a48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69164c1-3019-4ca9-bf8c-fe5eba3d9505]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (f0511abb-3c35-40af-9626-13e6ec079ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4147dffc-32f3-4438-aa1a-6102ecce5640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:19 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 Jul 31 07:42:19 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4147dffc-32f3-4438-aa1a-6102ecce5640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156980498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63edbb95-b3ea-4ffc-9b25-8828c18d41fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:20Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d5d18d-4a8e-4235-9af6-b3546e17d8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d5d18d-4a8e-4235-9af6-b3546e17d8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:19 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1167013c-2aaa-4c8d-a1e5-62b60f5448e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1167013c-2aaa-4c8d-a1e5-62b60f5448e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63edbb95-b3ea-4ffc-9b25-8828c18d41fc', 'volume_name': 'volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631bb206-3d9f-42d1-937b-cf17b50b3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631bb206-3d9f-42d1-937b-cf17b50b3e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2906c883-be6a-4633-b867-98e5b5b3e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:19 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Volume 63edbb95-b3ea-4ffc-9b25-8828c18d41fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc', 'volume_size': 1} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 1G" returned: 0 in 0.578s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:19 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f5cb8dd-58db-495d-a9cb-5d243967500e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:19 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f5cb8dd-58db-495d-a9cb-5d243967500e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 Jul 31 07:42:19 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:20 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48" returned: 0 in 0.461s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:20 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 Jul 31 07:42:20 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:20 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f5cb8dd-58db-495d-a9cb-5d243967500e -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03" returned: 0 in 0.377s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:20 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 is being set with open permissions: ugo+rw Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:20 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 Jul 31 07:42:20 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:20 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038" returned: 0 in 0.401s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:20 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03" returned: 0 in 0.291s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:20 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038 Jul 31 07:42:20 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:20 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.info Jul 31 07:42:20 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:20 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48.411b55de-ed22-42e0-894b-c654b84ea038" returned: 0 in 0.301s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-411b55de-ed22-42e0-894b-c654b84ea038" released by "_delete_snapshot" :: held 1.853s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:20 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.info" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:20 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.info is being set with open permissions: ugo+rw Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:20 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-599ef576-28e3-417c-85a7-d0b716805a48" released by "delete_snapshot" :: held 1.900s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:20 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.info Jul 31 07:42:20 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Created reservations ['f3f6d594-083a-48f2-98b9-36e84907d779', 'ba727745-f84b-4468-b268-5f99892d04ea', 'a7362dfb-d132-4821-a7c8-3b45bc42b8e1', 'ddfb1fa1-8ae1-4a95-84de-a08f17348d08'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Delete snapshot completed successfully. Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-13e1d8a2-f2f3-47d8-a8b1-87859f796e87 tempest-ProjectReaderTests-762434769 None] Lock "cinder-411b55de-ed22-42e0-894b-c654b84ea038-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:21 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-599ef576-28e3-417c-85a7-d0b716805a48-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.info" returned: 0 in 0.287s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156980498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63edbb95-b3ea-4ffc-9b25-8828c18d41fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:20Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Creating volume 63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:21 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:21 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc 1073741824 Jul 31 07:42:21 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Lock "cinder-599ef576-28e3-417c-85a7-d0b716805a48-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:21 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3c58a2e6-0e8f-455d-9cc9-52def3a75c6c tempest-CinderUnicodeTest-1058144228 None] Create snapshot completed successfully Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-599ef576-28e3-417c-85a7-d0b716805a48" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-599ef576-28e3-417c-85a7-d0b716805a48" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[83884c35-b1a7-4d18-9c07-1c066b08840f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:21 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 Jul 31 07:42:21 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:21 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc 1073741824" returned: 0 in 0.534s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:21 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "cinder-0092b7c4-b2d6-4a80-8386-442aaa2c8b03-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48" returned: 0 in 0.476s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:21 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc Jul 31 07:42:21 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-0092b7c4-b2d6-4a80-8386-442aaa2c8b03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "cinder-quobyte-7f5cb8dd-58db-495d-a9cb-5d243967500e" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:21 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48 Jul 31 07:42:21 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-7f5cb8dd-58db-495d-a9cb-5d243967500e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "cinder-quobyte-0092b7c4-b2d6-4a80-8386-442aaa2c8b03" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-0092b7c4-b2d6-4a80-8386-442aaa2c8b03" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Deleting offline snapshot 0092b7c4-b2d6-4a80-8386-442aaa2c8b03 of volume 7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] snapshot_file for this snap is: volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b191e-d28f-4c27-9d20-0e98270f392e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:21 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:22 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 Jul 31 07:42:22 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:22 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" returned: 0 in 0.313s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:22 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2906c883-be6a-4633-b867-98e5b5b3e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f543e4f3-061b-4365-951c-425eaf04fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-599ef576-28e3-417c-85a7-d0b716805a48" returned: 0 in 0.320s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:22 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Volume volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc (63edbb95-b3ea-4ffc-9b25-8828c18d41fc): created successfully Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f543e4f3-061b-4365-951c-425eaf04fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (f0511abb-3c35-40af-9626-13e6ec079ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-599ef576-28e3-417c-85a7-d0b716805a48" released by "delete_volume" :: held 0.893s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8f0d2d7a-cb81-485c-84ff-0e766dc3587c tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Created reservations ['0d0b919c-8069-4c69-9109-44b349fb870a', 'fddb994a-0a17-49a0-a4bb-f30c8d61b041', 'b625dc70-eacc-4268-9b55-5cbd82d48f73', 'c260b678-e602-4e04-9221-12be5a0342c0'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:22 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:22 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:22 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03" returned: 0 in 0.441s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f5cb8dd-58db-495d-a9cb-5d243967500e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf1c25a-9e26-4be1-a3e8-39e72590ca5b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:22 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e Jul 31 07:42:22 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:22 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:22 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Deleted volume successfully. Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-03d432aa-9740-48aa-9579-458e5538d018 tempest-ProjectReaderTests-762434769 None] Lock "cinder-599ef576-28e3-417c-85a7-d0b716805a48-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:22 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e" returned: 0 in 0.432s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:22 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:22 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 Jul 31 07:42:22 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Creating offline snapshot 56501a67-d85c-45be-8743-bcfb050dc132 of volume 63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c814a8f-461b-404f-ad93-33a2041ad9cf]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:23 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03" returned: 0 in 0.419s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:23 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03 Jul 31 07:42:23 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:23 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc Jul 31 07:42:23 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:23 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e.0092b7c4-b2d6-4a80-8386-442aaa2c8b03" returned: 0 in 0.319s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:23 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" returned: 0 in 0.453s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-0092b7c4-b2d6-4a80-8386-442aaa2c8b03" released by "_delete_snapshot" :: held 1.775s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-7f5cb8dd-58db-495d-a9cb-5d243967500e" released by "delete_snapshot" :: held 1.816s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:23 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 1G Jul 31 07:42:23 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Created reservations ['b10a67f4-9725-48d9-9a47-e01b1e14b198', '04005dae-fe25-4770-8b67-18c58b2c04ce', 'd510f308-e5a5-4774-b312-854491bd6f53', 'd40c2ddf-697f-4282-aa04-983d263fffe3'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:23 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Delete snapshot completed successfully. Jul 31 07:42:23 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-31dc2425-021a-4fad-8b76-a34196cc7aad tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-0092b7c4-b2d6-4a80-8386-442aaa2c8b03-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (683a6c3d-edae-4df6-94ff-94a7a00d45bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddd4d6a-bb06-43e1-a28c-1b7345700f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "cinder-7f5cb8dd-58db-495d-a9cb-5d243967500e-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddd4d6a-bb06-43e1-a28c-1b7345700f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031823668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:24Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8678915-103f-4f1c-93d0-afd5e3c87546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8678915-103f-4f1c-93d0-afd5e3c87546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87a90dd-9b55-4f79-8e36-5dbda84a2c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87a90dd-9b55-4f79-8e36-5dbda84a2c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31', 'volume_name': 'volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1064ea-42f9-4d9b-9dc1-ec761a81c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1064ea-42f9-4d9b-9dc1-ec761a81c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915b5c7f-c099-4fd1-9734-2ac730a77703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:24 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Volume e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31', 'volume_size': 1} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-7f5cb8dd-58db-495d-a9cb-5d243967500e-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "cinder-quobyte-7f5cb8dd-58db-495d-a9cb-5d243967500e" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-7f5cb8dd-58db-495d-a9cb-5d243967500e" acquired by "delete_volume" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:24 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 1G" returned: 0 in 0.625s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b8165-a99d-47fa-9e43-bedc47706aa0]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:24 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 Jul 31 07:42:24 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:24 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e Jul 31 07:42:24 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:24 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132" returned: 0 in 0.318s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:24 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 is being set with open permissions: ugo+rw Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:24 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 Jul 31 07:42:24 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:24 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e" returned: 0 in 0.390s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:24 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e Jul 31 07:42:24 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:24 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132" returned: 0 in 0.279s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:25 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.info Jul 31 07:42:25 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:25 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-7f5cb8dd-58db-495d-a9cb-5d243967500e" returned: 0 in 0.305s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-7f5cb8dd-58db-495d-a9cb-5d243967500e" released by "delete_volume" :: held 0.784s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Created reservations ['6bb1f7d6-7fc7-4696-9e3f-7984b9d567c8', 'bd37f212-1b1a-420d-b27a-1e386bb2444e', '4b3e31e0-1264-40b6-83cc-f3b0758583cb', 'cb3ee5d8-d50d-4021-a07e-43bbeb094ed1'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:25 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:25 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:25 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "cinder-850526dd-4c11-4ac6-99cb-945fa8a87dab-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.info" returned: 0 in 0.357s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:25 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.info is being set with open permissions: ugo+rw Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-850526dd-4c11-4ac6-99cb-945fa8a87dab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:25 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.info Jul 31 07:42:25 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "cinder-quobyte-850526dd-4c11-4ac6-99cb-945fa8a87dab" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-850526dd-4c11-4ac6-99cb-945fa8a87dab" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ec2d34-05bf-444e-acae-e54ba58ed044]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:25 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.330s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Deleted volume successfully. Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-1ccdb759-6c26-405d-a59f-00ee9434e890 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-7f5cb8dd-58db-495d-a9cb-5d243967500e-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:25 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.info" returned: 0 in 0.311s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:25 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab Jul 31 07:42:25 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031823668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:24Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Creating volume e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:25 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:25 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 1073741824 Jul 31 07:42:25 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:25 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-eeb6a7fa-a62c-421a-84fc-e4cd1a956a77 tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:42:25 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab" returned: 0 in 0.467s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:25 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab Jul 31 07:42:25 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:26 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 1073741824" returned: 0 in 0.504s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:26 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-850526dd-4c11-4ac6-99cb-945fa8a87dab" returned: 0 in 0.282s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:26 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 Jul 31 07:42:26 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-quobyte-850526dd-4c11-4ac6-99cb-945fa8a87dab" released by "delete_volume" :: held 0.819s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Created reservations ['700cb466-09fd-44a6-98ed-9a729d5e9625', '23793ebf-c05b-430c-9219-21a4d767f565', '35d1498e-32b4-4d99-afe0-ebacc3abd913', '06fa7d55-90ad-46d7-82cc-1692d8f1666f'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-56501a67-d85c-45be-8743-bcfb050dc132-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:26 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Lock "cinder-56501a67-d85c-45be-8743-bcfb050dc132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:26 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-56501a67-d85c-45be-8743-bcfb050dc132" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-56501a67-d85c-45be-8743-bcfb050dc132" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:26 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot 56501a67-d85c-45be-8743-bcfb050dc132 of volume 63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" returned: 0 in 0.328s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fe6ebd-712f-43d6-9814-342416ea19c1]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915b5c7f-c099-4fd1-9734-2ac730a77703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6783ec1-3478-4423-ba7c-3fa440f36403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:26 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Volume volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 (e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31): created successfully Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6783ec1-3478-4423-ba7c-3fa440f36403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (683a6c3d-edae-4df6-94ff-94a7a00d45bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:26 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6c17af54-ddd6-41e9-91f7-5b8f6ba7c709 tempest-ProjectReaderTests-762434769 None] Created volume successfully. Jul 31 07:42:26 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 Jul 31 07:42:26 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:26 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.314s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:26 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Deleted volume successfully. Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-19f523b9-c9f1-4a0a-91ba-7630031eb7b2 tempest-CinderUnicodeTest-1058144228 None] Lock "cinder-850526dd-4c11-4ac6-99cb-945fa8a87dab-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:26 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132" returned: 0 in 0.406s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60dd96a-61a8-4ab5-9d76-4829a6b3c9eb]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:27 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc Jul 31 07:42:27 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:27 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" returned: 0 in 0.420s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:27 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 Jul 31 07:42:27 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Creating offline snapshot 8927e579-12c8-4b3f-b231-2fce3b170053 of volume e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[a975b4d1-faa0-4b99-a93f-4b2b1796584c]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:27 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132" returned: 0 in 0.413s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:27 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 Jul 31 07:42:27 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:27 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132 Jul 31 07:42:27 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:28 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" returned: 0 in 0.433s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:28 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc.56501a67-d85c-45be-8743-bcfb050dc132" returned: 0 in 0.315s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:28 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 1G Jul 31 07:42:28 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-56501a67-d85c-45be-8743-bcfb050dc132" released by "_delete_snapshot" :: held 1.671s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" released by "delete_snapshot" :: held 1.702s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Created reservations ['cfcf812e-7df3-495a-96de-1954d06fb741', '2afdccf0-dcb0-4d98-a750-cf728e041dbb', '6ee8a497-892a-41bb-963b-f46f49cdbcfc', '3b34a178-c3c5-43c2-8d93-cda42d9c2288'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-6b3eff0c-093d-4dd7-99aa-377d9e5a92fb tempest-ProjectMemberTests-801608708 None] Lock "cinder-56501a67-d85c-45be-8743-bcfb050dc132-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:28 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 1G" returned: 0 in 0.418s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:28 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 Jul 31 07:42:28 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-63edbb95-b3ea-4ffc-9b25-8828c18d41fc-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Lock "cinder-63edbb95-b3ea-4ffc-9b25-8828c18d41fc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec49633-2a1c-4628-a29e-a344ae671250]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:28 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053" returned: 0 in 0.360s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:28 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 is being set with open permissions: ugo+rw Jul 31 07:42:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:28 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc Jul 31 07:42:28 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:28 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 Jul 31 07:42:28 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:29 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053" returned: 0 in 0.285s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:29 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" returned: 0 in 0.429s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:29 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc Jul 31 07:42:29 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:29 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.info Jul 31 07:42:29 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:29 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:29 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.info" returned: 0 in 0.277s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:29 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.info is being set with open permissions: ugo+rw Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-63edbb95-b3ea-4ffc-9b25-8828c18d41fc" released by "delete_volume" :: held 0.799s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:29 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.info Jul 31 07:42:29 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Created reservations ['ea4bdfba-e0a7-410a-a0f1-05799464af49', 'b604ed6a-fdf1-4dec-9722-aa43e9229713', '1c4e10fa-4c42-4f75-adfa-401a1ec9c415', '248e718a-da0f-4503-a165-e07eb6628c09'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:29 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:29 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:29 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.info" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-545ac6f5-4329-4f55-ab72-da6b2380b522 tempest-ProjectReaderTests-762434769 None] Create snapshot completed successfully Jul 31 07:42:29 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:29 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:29 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-686ec2c7-5f28-4c8e-a37b-bc0e3b143f51 tempest-ProjectMemberTests-801608708 None] Lock "cinder-63edbb95-b3ea-4ffc-9b25-8828c18d41fc-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (ee3bda0b-5d79-40e2-9d94-11cd3528a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe478b4-9e13-4dbc-bb71-f7acd64d5e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe478b4-9e13-4dbc-bb71-f7acd64d5e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077972408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704cc21e-2150-464e-befb-e6ccce9d5c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:30Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d9ff7c-18f8-4997-8b84-2b58dba192f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d9ff7c-18f8-4997-8b84-2b58dba192f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c54a0b-9c56-4d99-804d-cff905b4e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c54a0b-9c56-4d99-804d-cff905b4e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704cc21e-2150-464e-befb-e6ccce9d5c26', 'volume_name': 'volume-704cc21e-2150-464e-befb-e6ccce9d5c26', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1da375-9999-4ebf-85a0-40e79502cd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1da375-9999-4ebf-85a0-40e79502cd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44608c29-8c85-497e-a831-f45988508d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:30 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Volume 704cc21e-2150-464e-befb-e6ccce9d5c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704cc21e-2150-464e-befb-e6ccce9d5c26', 'volume_size': 1} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077972408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704cc21e-2150-464e-befb-e6ccce9d5c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:30Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Creating volume 704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:30 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:30 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 1073741824 Jul 31 07:42:30 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:30 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-8927e579-12c8-4b3f-b231-2fce3b170053-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 1073741824" returned: 0 in 0.459s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Lock "cinder-8927e579-12c8-4b3f-b231-2fce3b170053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-8927e579-12c8-4b3f-b231-2fce3b170053" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-8927e579-12c8-4b3f-b231-2fce3b170053" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Deleting offline snapshot 8927e579-12c8-4b3f-b231-2fce3b170053 of volume e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:30 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 Jul 31 07:42:30 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] snapshot_file for this snap is: volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f203b8-cd8d-4ddd-89d7-b587e71267ad]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:31 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 Jul 31 07:42:31 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:31 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44608c29-8c85-497e-a831-f45988508d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704cc21e-2150-464e-befb-e6ccce9d5c26', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7031bb-7d16-44e8-a224-bc738de5b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:31 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Volume volume-704cc21e-2150-464e-befb-e6ccce9d5c26 (704cc21e-2150-464e-befb-e6ccce9d5c26): created successfully Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7031bb-7d16-44e8-a224-bc738de5b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (ee3bda0b-5d79-40e2-9d94-11cd3528a7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:31 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-807f2a85-fae2-4a01-910f-9c965b3ebcd1 tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:42:31 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053" returned: 0 in 0.383s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49637a3-4b50-4258-b142-2c393c6fb0ac]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:31 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 Jul 31 07:42:31 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:31 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" returned: 0 in 0.376s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:31 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:31 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 Jul 31 07:42:31 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:32 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053" returned: 0 in 0.366s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:32 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053 Jul 31 07:42:32 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:32 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31.8927e579-12c8-4b3f-b231-2fce3b170053" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-8927e579-12c8-4b3f-b231-2fce3b170053" released by "_delete_snapshot" :: held 1.505s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" released by "delete_snapshot" :: held 1.550s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Created reservations ['31cc511a-712c-466f-8e16-ce4de1fdea2a', 'f94c460a-915c-4acd-ac69-d775888c6595', 'f7e76ea6-2d66-4304-84da-0d321576dff7', '21b38d33-5fe1-4134-8561-cccc08e1f789'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:32 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Delete snapshot completed successfully. Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bd03861e-2625-46af-b5ea-5f689671cbb5 tempest-ProjectReaderTests-762434769 None] Lock "cinder-8927e579-12c8-4b3f-b231-2fce3b170053-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Creating offline snapshot 2e7187ff-2391-40a5-b8f4-7230a656d023 of volume 704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[19726a76-7ba6-44dd-b614-fe64d16b059e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:32 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 Jul 31 07:42:32 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Lock "cinder-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:33 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26" returned: 0 in 0.465s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[825b378b-5259-4bbf-a2ba-a8972854a1e7]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:33 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 1G Jul 31 07:42:33 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:33 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 Jul 31 07:42:33 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:33 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" returned: 0 in 0.393s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:33 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31 Jul 31 07:42:33 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:33 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 1G" returned: 0 in 0.496s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704cc21e-2150-464e-befb-e6ccce9d5c26 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:33 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704cc21e-2150-464e-befb-e6ccce9d5c26 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 Jul 31 07:42:33 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:33 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:33 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:33 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" returned: 0 in 0.302s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31" released by "delete_volume" :: held 0.767s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Created reservations ['bda79d7d-7cea-474c-8c68-4e54037a68f8', '489347a1-a6c6-426b-a856-8fd38a7f3853', 'e3d21bd6-50a8-4743-b992-9cb7e60a6e71', '2109ddb0-b6e1-4574-b035-833e46e67ea9'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:34 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:34 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704cc21e-2150-464e-befb-e6ccce9d5c26 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023" returned: 0 in 0.416s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:34 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 is being set with open permissions: ugo+rw Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.355s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:34 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 Jul 31 07:42:34 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:42:34 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:34 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:34 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.291s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Deleted volume successfully. Jul 31 07:42:34 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023" returned: 0 in 0.382s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c40512de-46f2-4b7b-95d2-62c42a2d8d67 tempest-ProjectReaderTests-762434769 None] Lock "cinder-e6f6c7f9-ef47-4f3b-a66d-7de3b74aab31-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:34 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.info Jul 31 07:42:34 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:34 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.info" returned: 0 in 0.365s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:34 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.info is being set with open permissions: ugo+rw Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:34 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.info Jul 31 07:42:34 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (392d43f2-ad36-4b95-bb10-75505f00f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f31c19-c6e7-4209-a085-d300ecb7d509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f31c19-c6e7-4209-a085-d300ecb7d509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-72256795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27190dc0-e051-45ae-ba66-044564f4b033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:35Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77219613-e8d3-48bd-b268-b6025f2dc00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77219613-e8d3-48bd-b268-b6025f2dc00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23802935-689d-4c04-b125-dd3440b94e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23802935-689d-4c04-b125-dd3440b94e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27190dc0-e051-45ae-ba66-044564f4b033', 'volume_name': 'volume-27190dc0-e051-45ae-ba66-044564f4b033', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dcaf97-07a1-40d9-8a27-eb67049f328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dcaf97-07a1-40d9-8a27-eb67049f328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91f9857-04b1-43bf-a703-914df78ce6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:35 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Volume 27190dc0-e051-45ae-ba66-044564f4b033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27190dc0-e051-45ae-ba66-044564f4b033', 'volume_size': 1} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:35 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.info" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-72256795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27190dc0-e051-45ae-ba66-044564f4b033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:35Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Creating volume 27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:35 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:35 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 1073741824 Jul 31 07:42:35 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:35 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fb99d911-1101-44b6-b098-1c90d761535c tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:42:35 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 1073741824" returned: 0 in 0.430s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:35 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 Jul 31 07:42:35 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-2e7187ff-2391-40a5-b8f4-7230a656d023-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Lock "cinder-2e7187ff-2391-40a5-b8f4-7230a656d023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-704cc21e-2150-464e-befb-e6ccce9d5c26" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-704cc21e-2150-464e-befb-e6ccce9d5c26" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-2e7187ff-2391-40a5-b8f4-7230a656d023" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-2e7187ff-2391-40a5-b8f4-7230a656d023" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot 2e7187ff-2391-40a5-b8f4-7230a656d023 of volume 704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddef5c27-2b26-43ac-8851-69dd8a0f3a31]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:35 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033" returned: 0 in 0.350s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:35 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91f9857-04b1-43bf-a703-914df78ce6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27190dc0-e051-45ae-ba66-044564f4b033', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79af4ea6-5b18-485a-af17-65f33a7aba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:36 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Volume volume-27190dc0-e051-45ae-ba66-044564f4b033 (27190dc0-e051-45ae-ba66-044564f4b033): created successfully Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79af4ea6-5b18-485a-af17-65f33a7aba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (392d43f2-ad36-4b95-bb10-75505f00f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:36 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6fa38652-7a3c-446a-8c43-e025273f2dc1 tempest-ProjectReaderTests-762434769 None] Created volume successfully. Jul 31 07:42:36 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 Jul 31 07:42:36 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:36 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023" returned: 0 in 0.417s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-704cc21e-2150-464e-befb-e6ccce9d5c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec526ab-4389-44e0-8fff-c9914ccd8921]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:36 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 Jul 31 07:42:36 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:36 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:36 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 Jul 31 07:42:36 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Creating offline snapshot e38c22e7-d3d1-4c82-8e65-33aaea28083f of volume 27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[668bb201-2f7b-4165-8c5d-3e276c563b19]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:37 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023" returned: 0 in 0.444s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:37 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023 Jul 31 07:42:37 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:37 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 Jul 31 07:42:37 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:37 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26.2e7187ff-2391-40a5-b8f4-7230a656d023" returned: 0 in 0.288s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:37 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-2e7187ff-2391-40a5-b8f4-7230a656d023" released by "_delete_snapshot" :: held 1.672s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-704cc21e-2150-464e-befb-e6ccce9d5c26" released by "delete_snapshot" :: held 1.704s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:37 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f 1G Jul 31 07:42:37 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Created reservations ['e25ef097-21ba-4def-8600-dca76d2483ed', '1ab1b7c7-df02-4990-b2ee-49f9c1abd969', 'a9d9186d-ead7-43a2-9285-c9523f8f0152', '42245a46-025c-4750-8026-c737341f4418'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:42:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ffd831f8-5b14-47ea-b549-c15ec13a2253 tempest-ProjectMemberTests-801608708 None] Lock "cinder-2e7187ff-2391-40a5-b8f4-7230a656d023-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-704cc21e-2150-464e-befb-e6ccce9d5c26-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Lock "cinder-704cc21e-2150-464e-befb-e6ccce9d5c26-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:38 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-704cc21e-2150-464e-befb-e6ccce9d5c26" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f 1G" returned: 0 in 0.577s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27190dc0-e051-45ae-ba66-044564f4b033 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-704cc21e-2150-464e-befb-e6ccce9d5c26" acquired by "delete_volume" :: waited 0.029s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:38 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27190dc0-e051-45ae-ba66-044564f4b033 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f Jul 31 07:42:38 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[0013b8e6-ee85-4a9a-b014-c56af5608b3d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:38 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 Jul 31 07:42:38 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:38 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27190dc0-e051-45ae-ba66-044564f4b033 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f" returned: 0 in 0.307s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:38 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f is being set with open permissions: ugo+rw Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:38 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f Jul 31 07:42:38 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:38 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26" returned: 0 in 0.346s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:38 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26 Jul 31 07:42:38 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:38 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f" returned: 0 in 0.261s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:38 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.info Jul 31 07:42:38 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:38 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-704cc21e-2150-464e-befb-e6ccce9d5c26" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-704cc21e-2150-464e-befb-e6ccce9d5c26" released by "delete_volume" :: held 0.696s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Created reservations ['61bba0c0-f6cc-4fc8-b391-b286a0a872fa', '9c1e4ef9-34e7-4b75-a8f2-a976f9be4ffd', '8fa995c3-cfa3-4767-8c4d-6999514dc3d9', '0ba33814-2a40-42fb-9872-3a1f2c7f6ed5'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:39 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:39 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:39 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.info" returned: 0 in 0.284s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:39 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.info is being set with open permissions: ugo+rw Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:39 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.info Jul 31 07:42:39 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:39 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.269s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:39 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-05d8b637-d851-4fe4-8035-bd2ef0862331 tempest-ProjectMemberTests-801608708 None] Lock "cinder-704cc21e-2150-464e-befb-e6ccce9d5c26-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:39 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.info" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:39 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-dad49d6b-b625-443b-ade1-7271b72be124 tempest-ProjectReaderTests-762434769 None] Create snapshot completed successfully Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (484e38f4-82c0-4312-a9f2-0f8c5f8ec33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b27eecc-2232-49d4-b224-bb215fff5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b27eecc-2232-49d4-b224-bb215fff5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826108430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb5d61b-3c91-43ed-a17e-065bcecf8aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:40Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5e80ca-d4f1-4559-bf94-c4821588b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5e80ca-d4f1-4559-bf94-c4821588b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4bc1c3-5cca-4ccf-9787-57d45a740833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4bc1c3-5cca-4ccf-9787-57d45a740833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb5d61b-3c91-43ed-a17e-065bcecf8aa8', 'volume_name': 'volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019d45ef-aaba-4d38-861e-a17549ac02eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019d45ef-aaba-4d38-861e-a17549ac02eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c5c1f-2150-4828-a658-a3f954d6b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:39 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Volume 9eb5d61b-3c91-43ed-a17e-065bcecf8aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8', 'volume_size': 1} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826108430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb5d61b-3c91-43ed-a17e-065bcecf8aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:40Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Creating volume 9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:39 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:39 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 1073741824 Jul 31 07:42:39 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:40 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 1073741824" returned: 0 in 0.415s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:40 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 Jul 31 07:42:40 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-e38c22e7-d3d1-4c82-8e65-33aaea28083f-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Lock "cinder-e38c22e7-d3d1-4c82-8e65-33aaea28083f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-27190dc0-e051-45ae-ba66-044564f4b033" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:40 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-27190dc0-e051-45ae-ba66-044564f4b033" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-e38c22e7-d3d1-4c82-8e65-33aaea28083f" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-e38c22e7-d3d1-4c82-8e65-33aaea28083f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Deleting offline snapshot e38c22e7-d3d1-4c82-8e65-33aaea28083f of volume 27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] snapshot_file for this snap is: volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6ab79-6101-4d61-862f-88892b5778a7]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" returned: 0 in 0.267s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c5c1f-2150-4828-a658-a3f954d6b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089504cd-2f4c-4f0d-8213-c0fd51198dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:40 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Volume volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 (9eb5d61b-3c91-43ed-a17e-065bcecf8aa8): created successfully Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089504cd-2f4c-4f0d-8213-c0fd51198dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (484e38f4-82c0-4312-a9f2-0f8c5f8ec33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:40 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8ce073e7-df69-4c86-92cc-f9caa249fc0f tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:42:40 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f Jul 31 07:42:40 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:40 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f" returned: 0 in 0.399s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27190dc0-e051-45ae-ba66-044564f4b033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5875b9b2-5547-4bcc-bce6-59f698a0dfdd]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Creating offline snapshot 534b2ff1-988b-49f7-a12d-db38d1eb8c9b of volume 9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08b73d-80ad-4fae-8ab2-c11e221f155a]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:41 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 Jul 31 07:42:41 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:41 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 Jul 31 07:42:41 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:41 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033" returned: 0 in 0.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:41 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f Jul 31 07:42:41 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:41 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" returned: 0 in 0.371s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:41 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b 1G Jul 31 07:42:41 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:41 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f" returned: 0 in 0.345s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:41 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f Jul 31 07:42:41 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:41 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b 1G" returned: 0 in 0.427s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:41 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b Jul 31 07:42:41 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:41 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033.e38c22e7-d3d1-4c82-8e65-33aaea28083f" returned: 0 in 0.289s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-e38c22e7-d3d1-4c82-8e65-33aaea28083f" released by "_delete_snapshot" :: held 1.563s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:41 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-27190dc0-e051-45ae-ba66-044564f4b033" released by "delete_snapshot" :: held 1.587s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Created reservations ['f9829869-7972-4f1f-8605-703a40da0335', '8510bc97-b88b-4188-995c-68f117340a17', '0c991fdc-6b40-4a4f-b5c4-70191616428a', '53f1150b-554f-42de-9928-7c5ddf4b0abe'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Delete snapshot completed successfully. Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-3bb3be22-cef1-4f07-a238-cb1ffc1fc62c tempest-ProjectReaderTests-762434769 None] Lock "cinder-e38c22e7-d3d1-4c82-8e65-33aaea28083f-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:42 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b" returned: 0 in 0.360s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:42 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b is being set with open permissions: ugo+rw Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:42 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b Jul 31 07:42:42 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:42 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:42 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.info Jul 31 07:42:42 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-27190dc0-e051-45ae-ba66-044564f4b033-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Lock "cinder-27190dc0-e051-45ae-ba66-044564f4b033-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-27190dc0-e051-45ae-ba66-044564f4b033" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-27190dc0-e051-45ae-ba66-044564f4b033" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[31628e09-35b7-469a-844d-e926c369ec87]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:42 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.info" returned: 0 in 0.305s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:42 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.info is being set with open permissions: ugo+rw Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:42 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.info Jul 31 07:42:42 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:42 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 Jul 31 07:42:42 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:42 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.info" returned: 0 in 0.271s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:43 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:43 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-8efb9e50-836f-49ea-8097-d88ba990b7e8 tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033" returned: 0 in 0.410s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:43 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033 Jul 31 07:42:43 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:43 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-27190dc0-e051-45ae-ba66-044564f4b033" returned: 0 in 0.249s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-27190dc0-e051-45ae-ba66-044564f4b033" released by "delete_volume" :: held 0.724s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Created reservations ['380a9db3-0ff5-4a96-be9c-80c39cadfc92', 'ad404f1c-51e8-4781-8e69-761bbc95d141', 'f89a95fa-de10-4b84-8581-cf9568601cfb', 'f5a2ed05-26a8-461a-a53b-2fc59b38dc93'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:43 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:43 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:43 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.262s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:43 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Deleted volume successfully. Jul 31 07:42:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-0d5d9034-248f-4a28-9395-bf946c2c4b50 tempest-ProjectReaderTests-762434769 None] Lock "cinder-27190dc0-e051-45ae-ba66-044564f4b033-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-534b2ff1-988b-49f7-a12d-db38d1eb8c9b-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (04e51de6-0628-406c-9dc1-dc1e469c0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c5f45a-0de8-424b-9beb-25a220b2997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Lock "cinder-534b2ff1-988b-49f7-a12d-db38d1eb8c9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c5f45a-0de8-424b-9beb-25a220b2997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498358390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7a20bd-89f3-44a5-8a35-c36498ade3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:44Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaca6d56-b94f-499b-916b-f5cd70214fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaca6d56-b94f-499b-916b-f5cd70214fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e53760-d7e2-442c-a0a3-233ac280c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e53760-d7e2-442c-a0a3-233ac280c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7a20bd-89f3-44a5-8a35-c36498ade3fa', 'volume_name': 'volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2142d7-f1ce-4441-8908-9351063178c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2142d7-f1ce-4441-8908-9351063178c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e97f92-efd1-4e72-8f2f-e4a55bbbd1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Volume bf7a20bd-89f3-44a5-8a35-c36498ade3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa', 'volume_size': 1} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498358390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7a20bd-89f3-44a5-8a35-c36498ade3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7e710988214139851f56870fa37dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:44Z,use_quota=True,user_id='2a4bfb8054fa4688b92d4a97261d44d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Creating volume bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:44 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" acquired by "delete_snapshot" :: waited 0.086s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-534b2ff1-988b-49f7-a12d-db38d1eb8c9b" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:44 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa 1073741824 Jul 31 07:42:44 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-534b2ff1-988b-49f7-a12d-db38d1eb8c9b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot 534b2ff1-988b-49f7-a12d-db38d1eb8c9b of volume 9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3b2680-0d75-43f2-a3a5-15ea6cee6666]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:44 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b Jul 31 07:42:44 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:44 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa 1073741824" returned: 0 in 0.425s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:44 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b" returned: 0 in 0.396s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:44 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa Jul 31 07:42:44 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[540f7480-d9b1-4147-a557-a6611d2fb88b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:44 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 Jul 31 07:42:44 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:44 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" returned: 0 in 0.272s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e97f92-efd1-4e72-8f2f-e4a55bbbd1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:44 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c087b66a-699e-4857-b9ef-1c853c7536b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:44 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Volume volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa (bf7a20bd-89f3-44a5-8a35-c36498ade3fa): created successfully Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c087b66a-699e-4857-b9ef-1c853c7536b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Flow 'volume_create_manager' (04e51de6-0628-406c-9dc1-dc1e469c0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-60d8909b-53bf-426d-b34e-1aa34c9a8bff tempest-ProjectReaderTests-762434769 None] Created volume successfully. Jul 31 07:42:45 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" returned: 0 in 0.408s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:45 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b Jul 31 07:42:45 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Creating offline snapshot 66194ac1-2fcf-4e17-879d-afc76e06bd17 of volume bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c712faf-672e-4c50-a139-723b005c1db5]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:45 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa Jul 31 07:42:45 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:45 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b" returned: 0 in 0.362s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:45 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b Jul 31 07:42:45 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:45 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" returned: 0 in 0.397s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:45 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 1G Jul 31 07:42:45 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:45 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8.534b2ff1-988b-49f7-a12d-db38d1eb8c9b" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-534b2ff1-988b-49f7-a12d-db38d1eb8c9b" released by "_delete_snapshot" :: held 1.531s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" released by "delete_snapshot" :: held 1.558s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Created reservations ['a4d2a362-f143-447a-93fe-f8f112a053c8', '2c708d9a-0778-4b6e-a8bb-876f34477d91', '908e42eb-09b2-496d-98a0-531bbb493959', '37c6c306-8330-4761-bbd8-efd76a799459'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:45 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:42:45 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-80c255ad-7cc3-499c-9d13-021df128eacb tempest-ProjectMemberTests-801608708 None] Lock "cinder-534b2ff1-988b-49f7-a12d-db38d1eb8c9b-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:46 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 1G" returned: 0 in 0.443s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:46 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 Jul 31 07:42:46 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Lock "cinder-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[874a6643-3944-48d3-8cfa-9c3155d949df]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:46 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17" returned: 0 in 0.350s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:46 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 is being set with open permissions: ugo+rw Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:46 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 Jul 31 07:42:46 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:46 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 Jul 31 07:42:46 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:46 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:46 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" returned: 0 in 0.402s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:46 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:46 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8 Jul 31 07:42:46 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:46 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.info Jul 31 07:42:46 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:47 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" returned: 0 in 0.274s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8" released by "delete_volume" :: held 0.743s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:47 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.info" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:47 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.info is being set with open permissions: ugo+rw Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:47 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.info Jul 31 07:42:47 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Created reservations ['345fb185-b60d-4a7a-963c-15162ce84ce6', '47593522-7121-46ad-ab5e-8a90a38ef0db', '887c01f5-76fd-49af-aeb4-03db7cbc36ee', 'f4629f43-302f-40b8-9433-10dd6e6c5418'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:47 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:47 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:47 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.info" returned: 0 in 0.270s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e0ea3d40-ec19-48f1-9645-3b0cdca2c61c tempest-ProjectReaderTests-762434769 None] Create snapshot completed successfully Jul 31 07:42:47 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.278s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:47 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-c97b6582-7e67-4a6e-8ca4-a0c24b199c61 tempest-ProjectMemberTests-801608708 None] Lock "cinder-9eb5d61b-3c91-43ed-a17e-065bcecf8aa8-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (7b8a8bc4-69c4-4ee4-a369-1e317cf245f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06432b98-a3a4-4ad2-8f06-8544ac313c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06432b98-a3a4-4ad2-8f06-8544ac313c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709993584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2214e70e-7fbd-473c-a2f0-d18ca3312234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:48Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace604df-3736-48e0-8fa4-45d8ce371550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace604df-3736-48e0-8fa4-45d8ce371550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f5077f-833e-43c3-9f81-b6a4e719d455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f5077f-833e-43c3-9f81-b6a4e719d455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2214e70e-7fbd-473c-a2f0-d18ca3312234', 'volume_name': 'volume-2214e70e-7fbd-473c-a2f0-d18ca3312234', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16da6960-dff0-471f-bd72-2f419792755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16da6960-dff0-471f-bd72-2f419792755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fb966e-98d0-47b2-b276-2711c0f41a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:47 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Volume 2214e70e-7fbd-473c-a2f0-d18ca3312234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2214e70e-7fbd-473c-a2f0-d18ca3312234', 'volume_size': 1} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709993584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2214e70e-7fbd-473c-a2f0-d18ca3312234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:48Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Creating volume 2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:47 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:48 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:48 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 1073741824 Jul 31 07:42:48 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:48 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 1073741824" returned: 0 in 0.440s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-66194ac1-2fcf-4e17-879d-afc76e06bd17-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:48 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 Jul 31 07:42:48 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Lock "cinder-66194ac1-2fcf-4e17-879d-afc76e06bd17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-66194ac1-2fcf-4e17-879d-afc76e06bd17" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-66194ac1-2fcf-4e17-879d-afc76e06bd17" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Deleting offline snapshot 66194ac1-2fcf-4e17-879d-afc76e06bd17 of volume bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] snapshot_file for this snap is: volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2611161-c153-4faa-9e2d-71b8ff66f227]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:48 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 Jul 31 07:42:48 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:48 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fb966e-98d0-47b2-b276-2711c0f41a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2214e70e-7fbd-473c-a2f0-d18ca3312234', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11074b07-870a-485a-8eab-1f1cf06d2091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:48 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Volume volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 (2214e70e-7fbd-473c-a2f0-d18ca3312234): created successfully Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11074b07-870a-485a-8eab-1f1cf06d2091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (7b8a8bc4-69c4-4ee4-a369-1e317cf245f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:48 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-08bf7767-32ed-4fc8-8378-6bbf6e42f97b tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:42:48 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17" returned: 0 in 0.403s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:48 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a447f1-e9af-4a0e-9b17-5edd4188b0f8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Creating offline snapshot bb0cad70-2909-4c92-a789-711b3be2e3b5 of volume 2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8398ad9e-1dd7-4b2c-9f2a-8b72f0894f4b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:49 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa Jul 31 07:42:49 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:49 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 Jul 31 07:42:49 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:49 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" returned: 0 in 0.385s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:49 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 Jul 31 07:42:49 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:49 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234" returned: 0 in 0.382s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:49 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 1G Jul 31 07:42:49 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:49 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17" returned: 0 in 0.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:49 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17 Jul 31 07:42:49 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:49 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 1G" returned: 0 in 0.429s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:49 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:49 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 Jul 31 07:42:49 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:50 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa.66194ac1-2fcf-4e17-879d-afc76e06bd17" returned: 0 in 0.269s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-66194ac1-2fcf-4e17-879d-afc76e06bd17" released by "_delete_snapshot" :: held 1.562s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" released by "delete_snapshot" :: held 1.592s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Created reservations ['75169d8d-d3f1-4615-8f3b-259174cf9d02', 'fc118c45-7171-4b4b-ba6a-75b911eda668', '88deab48-dd18-4364-aa43-2514dd154d37', '2de22a12-faec-434f-af9d-8a907fefefcb'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:50 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Delete snapshot completed successfully. Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-bb3a8467-0916-4d67-a202-1671f45a419e tempest-ProjectReaderTests-762434769 None] Lock "cinder-66194ac1-2fcf-4e17-879d-afc76e06bd17-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:50 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5" returned: 0 in 0.334s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:50 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 is being set with open permissions: ugo+rw Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:50 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 Jul 31 07:42:50 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:50 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5" returned: 0 in 0.252s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:50 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.info Jul 31 07:42:50 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-bf7a20bd-89f3-44a5-8a35-c36498ade3fa-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Lock "cinder-bf7a20bd-89f3-44a5-8a35-c36498ade3fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Acquiring lock "cinder-quobyte-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" acquired by "delete_volume" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a3efbc-e944-4198-9354-0d794317ad9d]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:50 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.info" returned: 0 in 0.273s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:50 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.info is being set with open permissions: ugo+rw Jul 31 07:42:50 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:50 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.info Jul 31 07:42:50 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:50 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa Jul 31 07:42:50 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:51 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.info" returned: 0 in 0.290s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:51 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" returned: 0 in 0.418s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-6fd93d9b-6a77-4d50-9122-516efefcfd59 tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:42:51 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa Jul 31 07:42:51 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:51 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" returned: 0 in 0.255s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Lock "cinder-quobyte-bf7a20bd-89f3-44a5-8a35-c36498ade3fa" released by "delete_volume" :: held 0.732s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Created reservations ['7dab8c9a-a0fb-4da0-a76c-a9065214b263', '2e58c554-8b35-4c02-af79-973fa0354937', '92e846b8-7b5a-46cd-9918-fc4b1632c2fd', '88071b59-2724-4cd0-9534-60bbc5e42d5e'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:51 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:51 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:51 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.264s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:51 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Deleted volume successfully. Jul 31 07:42:51 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a55e3deb-9bb1-4566-bf61-530e836e31cb tempest-ProjectReaderTests-762434769 None] Lock "cinder-bf7a20bd-89f3-44a5-8a35-c36498ade3fa-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-bb0cad70-2909-4c92-a789-711b3be2e3b5-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Lock "cinder-bb0cad70-2909-4c92-a789-711b3be2e3b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-2214e70e-7fbd-473c-a2f0-d18ca3312234" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-2214e70e-7fbd-473c-a2f0-d18ca3312234" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-bb0cad70-2909-4c92-a789-711b3be2e3b5" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-bb0cad70-2909-4c92-a789-711b3be2e3b5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot bb0cad70-2909-4c92-a789-711b3be2e3b5 of volume 2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba8ee81-1f58-4200-bbab-d946cdaf6a23]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:52 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 Jul 31 07:42:52 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:52 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5" returned: 0 in 0.416s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2214e70e-7fbd-473c-a2f0-d18ca3312234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5294eb-a1d9-4c8c-a508-31488964e086]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:52 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:52 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 Jul 31 07:42:52 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:53 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234" returned: 0 in 0.373s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:53 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 Jul 31 07:42:53 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:53 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5" returned: 0 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:53 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5 Jul 31 07:42:53 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:53 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234.bb0cad70-2909-4c92-a789-711b3be2e3b5" returned: 0 in 0.267s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-bb0cad70-2909-4c92-a789-711b3be2e3b5" released by "_delete_snapshot" :: held 1.543s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-2214e70e-7fbd-473c-a2f0-d18ca3312234" released by "delete_snapshot" :: held 1.571s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:53 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Created reservations ['e855a202-9c76-4845-a162-273384fa2520', '6ee4e236-e4cb-4553-9052-1012bab397a1', '1dfd7c9a-aa73-41b5-83b5-e5f326fc6659', '6a3006f5-d1e3-4641-b7f8-554894de6961'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:54 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-9dff6bd5-1ffd-4ee0-b419-16e30250fb5e tempest-ProjectMemberTests-801608708 None] Lock "cinder-bb0cad70-2909-4c92-a789-711b3be2e3b5-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-2214e70e-7fbd-473c-a2f0-d18ca3312234-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Lock "cinder-2214e70e-7fbd-473c-a2f0-d18ca3312234-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-2214e70e-7fbd-473c-a2f0-d18ca3312234" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-2214e70e-7fbd-473c-a2f0-d18ca3312234" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[062f10d2-c696-42e7-830d-e590c988e02f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:54 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 Jul 31 07:42:54 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:54 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234" returned: 0 in 0.392s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:54 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:55 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234 Jul 31 07:42:55 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:55 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2214e70e-7fbd-473c-a2f0-d18ca3312234" returned: 0 in 0.262s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-2214e70e-7fbd-473c-a2f0-d18ca3312234" released by "delete_volume" :: held 0.723s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Created reservations ['fd5346ff-f89f-4375-9544-7aec359db69c', '13bc8960-46f4-4b6a-9abf-fe3e2f184b8a', '006f2a27-b5ad-4291-a298-e6a595d5a279', '60f38110-1047-4bfd-87dc-413552880a2a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:55 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:42:55 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:55 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:42:55 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:42:55 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ecd431ff-4903-4b82-85b2-e906deee19b9 tempest-ProjectMemberTests-801608708 None] Lock "cinder-2214e70e-7fbd-473c-a2f0-d18ca3312234-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (8dee297e-5115-42bb-ba18-9671e684e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2fb56f-fe2c-4f1f-bb28-25034bdfc5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2fb56f-fe2c-4f1f-bb28-25034bdfc5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351956713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d86a25-452c-4281-b71c-657114e6f55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:56Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c0d7b-c644-4a5e-af1c-5f7b08a8add2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c0d7b-c644-4a5e-af1c-5f7b08a8add2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c792be5a-3263-4452-b1bf-09523e58e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c792be5a-3263-4452-b1bf-09523e58e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d86a25-452c-4281-b71c-657114e6f55c', 'volume_name': 'volume-f5d86a25-452c-4281-b71c-657114e6f55c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f15804-05d1-42d9-86f9-c1868c31df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f15804-05d1-42d9-86f9-c1868c31df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07b4f16-8856-4376-95e7-221e9aa9addb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:56 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Volume f5d86a25-452c-4281-b71c-657114e6f55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d86a25-452c-4281-b71c-657114e6f55c', 'volume_size': 1} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351956713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d86a25-452c-4281-b71c-657114e6f55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:42:56Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Creating volume f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:42:56 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:56 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c 1073741824 Jul 31 07:42:56 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:56 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c 1073741824" returned: 0 in 0.411s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:56 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:56 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c Jul 31 07:42:56 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:57 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c" returned: 0 in 0.257s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07b4f16-8856-4376-95e7-221e9aa9addb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d86a25-452c-4281-b71c-657114e6f55c', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24ec580-7e88-4388-9e94-4637b86aab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:42:57 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Volume volume-f5d86a25-452c-4281-b71c-657114e6f55c (f5d86a25-452c-4281-b71c-657114e6f55c): created successfully Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24ec580-7e88-4388-9e94-4637b86aab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (8dee297e-5115-42bb-ba18-9671e684e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:42:57 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-16ce23ee-f609-4d95-9c10-224426b0ff83 tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Creating offline snapshot 8f1f5dcd-5a54-4833-8169-711e10ff1f8c of volume f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd5b01-3b9f-48db-bb1c-cf47fa79ce17]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:57 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c Jul 31 07:42:57 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:57 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c" returned: 0 in 0.381s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:57 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:57 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c 1G Jul 31 07:42:57 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:58 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c 1G" returned: 0 in 0.411s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d86a25-452c-4281-b71c-657114e6f55c -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:58 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d86a25-452c-4281-b71c-657114e6f55c -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c Jul 31 07:42:58 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:58 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d86a25-452c-4281-b71c-657114e6f55c -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c" returned: 0 in 0.327s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:58 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c is being set with open permissions: ugo+rw Jul 31 07:42:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:58 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c Jul 31 07:42:58 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:58 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c" returned: 0 in 0.251s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:58 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:58 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.info Jul 31 07:42:58 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:59 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.info" returned: 0 in 0.257s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:59 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.info is being set with open permissions: ugo+rw Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:59 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.info Jul 31 07:42:59 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:42:59 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.info" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:42:59 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-11e46fbd-e488-4d1d-8050-d0f149091cba tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-8f1f5dcd-5a54-4833-8169-711e10ff1f8c-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Lock "cinder-8f1f5dcd-5a54-4833-8169-711e10ff1f8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-f5d86a25-452c-4281-b71c-657114e6f55c" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-f5d86a25-452c-4281-b71c-657114e6f55c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-8f1f5dcd-5a54-4833-8169-711e10ff1f8c" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-8f1f5dcd-5a54-4833-8169-711e10ff1f8c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot 8f1f5dcd-5a54-4833-8169-711e10ff1f8c of volume f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[180fffd4-9c17-4fc2-8675-0eca1374e711]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:42:59 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:42:59 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c Jul 31 07:42:59 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:00 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c" returned: 0 in 0.434s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5d86a25-452c-4281-b71c-657114e6f55c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0c8f73-c92c-4f86-8e1e-10c8af58dfcf]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:00 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c Jul 31 07:43:00 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:00 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c" returned: 0 in 0.409s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:00 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c Jul 31 07:43:00 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:00 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c" returned: 0 in 0.420s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:00 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:00 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c Jul 31 07:43:00 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:01 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c.8f1f5dcd-5a54-4833-8169-711e10ff1f8c" returned: 0 in 0.279s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-8f1f5dcd-5a54-4833-8169-711e10ff1f8c" released by "_delete_snapshot" :: held 1.655s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-f5d86a25-452c-4281-b71c-657114e6f55c" released by "delete_snapshot" :: held 1.685s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Created reservations ['0dce3b14-d076-4106-b899-98ce9db945f4', '97eea0de-e05f-47e9-b501-d9bf343f5ae8', 'ef6b5a08-614d-47cf-b2e0-cb9b5aba7cae', 'b65a512c-5860-4249-97bd-7dae223fc1cc'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:01 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-087ab4b6-c062-40aa-a5e8-05d7490d5c63 tempest-ProjectMemberTests-801608708 None] Lock "cinder-8f1f5dcd-5a54-4833-8169-711e10ff1f8c-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-f5d86a25-452c-4281-b71c-657114e6f55c-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Lock "cinder-f5d86a25-452c-4281-b71c-657114e6f55c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-f5d86a25-452c-4281-b71c-657114e6f55c" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-f5d86a25-452c-4281-b71c-657114e6f55c" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e4b47-035f-4500-b61a-e5f799486def]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:01 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:01 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c Jul 31 07:43:01 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:02 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c" returned: 0 in 0.413s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:02 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c Jul 31 07:43:02 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:02 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5d86a25-452c-4281-b71c-657114e6f55c" returned: 0 in 0.295s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-f5d86a25-452c-4281-b71c-657114e6f55c" released by "delete_volume" :: held 0.786s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Created reservations ['baa591ed-8304-44f0-a0c2-8657354d1358', '52cfc18d-66bd-4e16-8c6c-fe5c6c799871', '66225bb2-d52e-48d6-9436-9c74441613c9', '983c8499-8477-4ab3-bb3a-fffb4ab38fee'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:02 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:02 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:02 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:03 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.292s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:03 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-dbead28f-3dac-4ff8-9f23-efd65529c5bc tempest-ProjectMemberTests-801608708 None] Lock "cinder-f5d86a25-452c-4281-b71c-657114e6f55c-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (d168127f-3b24-4bb4-b6ff-a82b102ecb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb731c-a4ee-435a-a0f7-7551f7340d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb731c-a4ee-435a-a0f7-7551f7340d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400812386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:03Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165d3a59-840e-4027-9e1a-f9f1643fdc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165d3a59-840e-4027-9e1a-f9f1643fdc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de9475a-3238-4004-97cf-b5bd5b1c4919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de9475a-3238-4004-97cf-b5bd5b1c4919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4', 'volume_name': 'volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5f0570-f71e-4f27-825e-815e0bf628e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5f0570-f71e-4f27-825e-815e0bf628e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7238b0a-c7f0-43d7-958c-d4b2207fca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:03 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Volume a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4', 'volume_size': 1} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400812386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471550e8c8504903ac5f6687ba874745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:03Z,use_quota=True,user_id='77c1628564fd4044af16d5412c21c162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Creating volume a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:43:03 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:43:03 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:03 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 1073741824 Jul 31 07:43:03 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:04 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 1073741824" returned: 0 in 0.514s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:04 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 Jul 31 07:43:04 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:04 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" returned: 0 in 0.267s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7238b0a-c7f0-43d7-958c-d4b2207fca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4adc70-5948-4c73-8ce3-cae25fb353c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:04 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Volume volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 (a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4): created successfully Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4adc70-5948-4c73-8ce3-cae25fb353c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:04 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Flow 'volume_create_manager' (d168127f-3b24-4bb4-b6ff-a82b102ecb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:04 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-2f462296-14d3-4a37-83ee-640ff791ebbd tempest-ProjectMemberTests-801608708 None] Created volume successfully. Jul 31 07:43:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:05 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Creating offline snapshot 687014dd-790a-455c-b007-e5180e47593a of volume a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:43:05 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be6b04-6268-4e46-986c-fa70320e6df8]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:05 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:05 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 Jul 31 07:43:05 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:06 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" returned: 0 in 0.357s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:06 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a 1G Jul 31 07:43:06 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:06 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a 1G" returned: 0 in 0.431s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:06 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a Jul 31 07:43:06 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:06 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a" returned: 0 in 0.291s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:06 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a is being set with open permissions: ugo+rw Jul 31 07:43:06 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:06 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a Jul 31 07:43:06 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:07 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=209,cinder:INSERT=71,cinder:UPDATE=270,cinder:DELETE=20 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=198,cinder:INSERT=75,cinder:UPDATE=265,cinder:DELETE=23 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:07 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.info Jul 31 07:43:07 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:07 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.info" returned: 0 in 0.250s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:07 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.info is being set with open permissions: ugo+rw Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:07 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.info Jul 31 07:43:07 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:07 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.info" returned: 0 in 0.264s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:07 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-33a23292-3bc0-4756-bd44-c1308765bdf9 tempest-ProjectMemberTests-801608708 None] Create snapshot completed successfully Jul 31 07:43:07 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-687014dd-790a-455c-b007-e5180e47593a-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Lock "cinder-687014dd-790a-455c-b007-e5180e47593a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-687014dd-790a-455c-b007-e5180e47593a" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-687014dd-790a-455c-b007-e5180e47593a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Deleting offline snapshot 687014dd-790a-455c-b007-e5180e47593a of volume a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] snapshot_file for this snap is: volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b45f1-9c4d-4630-b898-968adbc62a25]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:08 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a Jul 31 07:43:08 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:08 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a" returned: 0 in 0.364s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[02923c23-0057-4a44-9725-ba44531277ad]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:08 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 Jul 31 07:43:08 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:08 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" returned: 0 in 0.421s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:08 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:08 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a Jul 31 07:43:08 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:09 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:09 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a Jul 31 07:43:09 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:09 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4.687014dd-790a-455c-b007-e5180e47593a" returned: 0 in 0.257s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:09 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-687014dd-790a-455c-b007-e5180e47593a" released by "_delete_snapshot" :: held 1.527s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" released by "delete_snapshot" :: held 1.555s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:09 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Created reservations ['64a20ab7-0ca1-4f5d-bd6e-66ae0e876111', '428c2bea-23c9-472c-ab22-447e50736516', '93e131d3-ba95-426e-89b2-ea9d69b268d6', '065fbb8c-d334-47d9-8f2d-a0fcb78d939c'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:09 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Delete snapshot completed successfully. Jul 31 07:43:09 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-b74f7cbc-7389-46b3-9395-4963507d1d84 tempest-ProjectMemberTests-801608708 None] Lock "cinder-687014dd-790a-455c-b007-e5180e47593a-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Lock "cinder-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Acquiring lock "cinder-quobyte-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2bea18-0880-4c83-ae9c-7ec589e29538]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:10 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 Jul 31 07:43:10 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:10 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" returned: 0 in 0.386s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:10 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:10 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4 Jul 31 07:43:10 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:11 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" returned: 0 in 0.281s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Lock "cinder-quobyte-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4" released by "delete_volume" :: held 0.739s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Created reservations ['ffb599a9-cae9-4772-b871-71a4a259dd26', 'c6bbb240-99c1-42ea-96e7-ed38d5872e05', '657a3e90-3f4e-4cf3-8405-7704fd62b79d', 'd8cc041e-d22c-4ee4-8f92-60efd994fb39'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:11 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:11 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:11 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.256s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:11 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Deleted volume successfully. Jul 31 07:43:11 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-090c3e16-0241-4aa8-be82-c04a6fe831d7 tempest-ProjectMemberTests-801608708 None] Lock "cinder-a95e59ac-6e12-4b39-a5c3-d7dcb1ebd6d4-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Flow 'volume_create_manager' (1e886115-f2f7-495b-b3bf-99fd75293f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a103f81f-e248-4c55-83fb-a7cb90b06fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a103f81f-e248-4c55-83fb-a7cb90b06fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-135929096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5312597-3c76-4062-ac87-4a5094a27493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bdbcb3f72ee43229209a8464ef00fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:14Z,use_quota=True,user_id='0d71f0f626d044548a7b3f2fd709d9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfafda09-7397-42d6-83b9-53ad217ce3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfafda09-7397-42d6-83b9-53ad217ce3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba9257a-991b-4f68-b4cb-c744b041f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba9257a-991b-4f68-b4cb-c744b041f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5312597-3c76-4062-ac87-4a5094a27493', 'volume_name': 'volume-f5312597-3c76-4062-ac87-4a5094a27493', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfeb588-154e-4278-b948-7688c95b61f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfeb588-154e-4278-b948-7688c95b61f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37e28cd-02ed-4688-ba94-0f86e99796c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:13 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Volume f5312597-3c76-4062-ac87-4a5094a27493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5312597-3c76-4062-ac87-4a5094a27493', 'volume_size': 1} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-135929096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5312597-3c76-4062-ac87-4a5094a27493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bdbcb3f72ee43229209a8464ef00fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:14Z,use_quota=True,user_id='0d71f0f626d044548a7b3f2fd709d9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Creating volume f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:43:13 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:43:13 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:13 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 1073741824 Jul 31 07:43:13 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:14 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 1073741824" returned: 0 in 0.437s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:14 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 Jul 31 07:43:14 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:14 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493" returned: 0 in 0.246s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37e28cd-02ed-4688-ba94-0f86e99796c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5312597-3c76-4062-ac87-4a5094a27493', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f681a997-fd77-4ae4-95d5-03eb57d38bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:14 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Volume volume-f5312597-3c76-4062-ac87-4a5094a27493 (f5312597-3c76-4062-ac87-4a5094a27493): created successfully Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f681a997-fd77-4ae4-95d5-03eb57d38bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Flow 'volume_create_manager' (1e886115-f2f7-495b-b3bf-99fd75293f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:14 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ce2d40c0-ca8a-4f90-9d40-6901a28fdf89 tempest-SnapshotDependencyTests-1950731997 None] Created volume successfully. Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Creating offline snapshot d3c53055-fcb0-4227-952b-fa14d277a8b0 of volume f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab35ceaa-5dcd-4a92-a9ed-08762f2ddf07]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:14 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:15 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 Jul 31 07:43:15 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:15 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493" returned: 0 in 0.375s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 1G {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:15 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 1G Jul 31 07:43:15 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:15 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 1G" returned: 0 in 0.391s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5312597-3c76-4062-ac87-4a5094a27493 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:15 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5312597-3c76-4062-ac87-4a5094a27493 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 Jul 31 07:43:15 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:15 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5312597-3c76-4062-ac87-4a5094a27493 -F qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0" returned: 0 in 0.283s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:15 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 is being set with open permissions: ugo+rw Jul 31 07:43:15 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:15 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 Jul 31 07:43:16 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:16 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0" returned: 0 in 0.246s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:16 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.info Jul 31 07:43:16 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:16 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.info" returned: 0 in 0.243s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:16 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.info is being set with open permissions: ugo+rw Jul 31 07:43:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.info {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:16 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.info Jul 31 07:43:16 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:16 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.info" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:16 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:16 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ae9f46cd-3921-43a3-8da0-c89205bb1ac2 tempest-SnapshotDependencyTests-1950731997 None] Create snapshot completed successfully Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Flow 'volume_create_manager' (38cd5441-ed6e-4a29-8ba1-896b3f1ef822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd14fe3-d949-4ff8-a936-7a17d0754956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd14fe3-d949-4ff8-a936-7a17d0754956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879005e9-9870-445d-98a6-dcf930aeb746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bdbcb3f72ee43229209a8464ef00fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3c53055-fcb0-4227-952b-fa14d277a8b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:18Z,use_quota=True,user_id='0d71f0f626d044548a7b3f2fd709d9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7511e2a0-95a8-4797-a8a5-fb817fa9ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7511e2a0-95a8-4797-a8a5-fb817fa9ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9880ba07-f472-4700-8164-7a8f06ed912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9880ba07-f472-4700-8164-7a8f06ed912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '879005e9-9870-445d-98a6-dcf930aeb746', 'volume_name': 'volume-879005e9-9870-445d-98a6-dcf930aeb746', 'volume_size': 1, 'snapshot_id': 'd3c53055-fcb0-4227-952b-fa14d277a8b0'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f41856e-df15-42b6-84a0-6336d3321630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f41856e-df15-42b6-84a0-6336d3321630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b904c6e-ac18-4a88-be3f-73fcd7cd31d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:17 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Volume 879005e9-9870-445d-98a6-dcf930aeb746: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-879005e9-9870-445d-98a6-dcf930aeb746', 'volume_size': 1, 'snapshot_id': 'd3c53055-fcb0-4227-952b-fa14d277a8b0'} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-quobyte-d3c53055-fcb0-4227-952b-fa14d277a8b0-879005e9-9870-445d-98a6-dcf930aeb746" by "_create_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-d3c53055-fcb0-4227-952b-fa14d277a8b0-879005e9-9870-445d-98a6-dcf930aeb746" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Creating volume 879005e9-9870-445d-98a6-dcf930aeb746 from snapshot d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-quobyte-879005e9-9870-445d-98a6-dcf930aeb746" by "_copy_volume_from_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-879005e9-9870-445d-98a6-dcf930aeb746" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] snapshot: d3c53055-fcb0-4227-952b-fa14d277a8b0, volume: 879005e9-9870-445d-98a6-dcf930aeb746, {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43feb2a-6860-444f-8baa-cb32348bfc8b]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:17 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:18 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 Jul 31 07:43:18 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:18 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0" returned: 0 in 0.357s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5312597-3c76-4062-ac87-4a5094a27493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Creating direct copy from snapshot {{(pid=88915) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d01fb98-4ae9-493b-bcf1-f6ff2fd53467]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:18 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 Jul 31 07:43:18 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:18 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493" returned: 0 in 0.395s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG cinder.utils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Path /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 not found in is_blk_device check {{(pid=88915) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 07:43:18 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:18 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 Jul 31 07:43:18 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:23 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746" returned: 0 in 4.665s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:23 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd8186-50e4-4460-bdbb-31386455979f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:23 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 Jul 31 07:43:23 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:23 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493" returned: 0 in 0.554s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:23 devstack cinder-volume[88915]: DEBUG cinder.image.image_utils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 {{(pid=88915) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 07:43:23 devstack cinder-volume[88915]: INFO cinder.image.image_utils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Converted 1024.00 MB image at 219.47 MB/s Jul 31 07:43:23 devstack cinder-volume[88915]: WARNING cinder.volume.drivers.remotefs [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 is being set with open permissions: ugo+rw Jul 31 07:43:23 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:23 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 Jul 31 07:43:23 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:24 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746" returned: 0 in 0.239s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-879005e9-9870-445d-98a6-dcf930aeb746" released by "_copy_volume_from_snapshot" :: held 6.314s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-d3c53055-fcb0-4227-952b-fa14d277a8b0-879005e9-9870-445d-98a6-dcf930aeb746" released by "_create_volume_from_snapshot" :: held 6.345s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.358s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b904c6e-ac18-4a88-be3f-73fcd7cd31d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879005e9-9870-445d-98a6-dcf930aeb746', 'volume_size': 1, 'snapshot_id': 'd3c53055-fcb0-4227-952b-fa14d277a8b0'}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446c35a5-6c72-4f0a-bf29-8335c56aaa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:24 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Volume volume-879005e9-9870-445d-98a6-dcf930aeb746 (879005e9-9870-445d-98a6-dcf930aeb746): created successfully Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446c35a5-6c72-4f0a-bf29-8335c56aaa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:24 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Flow 'volume_create_manager' (38cd5441-ed6e-4a29-8ba1-896b3f1ef822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:24 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a6a9e238-382a-47b4-aa12-06729bb440d2 tempest-SnapshotDependencyTests-1950731997 None] Created volume successfully. Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-d3c53055-fcb0-4227-952b-fa14d277a8b0-delete_snapshot" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-d3c53055-fcb0-4227-952b-fa14d277a8b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-quobyte-f5312597-3c76-4062-ac87-4a5094a27493" by "delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-f5312597-3c76-4062-ac87-4a5094a27493" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-quobyte-d3c53055-fcb0-4227-952b-fa14d277a8b0" by "_delete_snapshot" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-d3c53055-fcb0-4227-952b-fa14d277a8b0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Deleting offline snapshot d3c53055-fcb0-4227-952b-fa14d277a8b0 of volume f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] snapshot_file for this snap is: volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb5bc0-ccf8-4d06-acb6-a21b4e2ef332]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:25 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 Jul 31 07:43:25 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:25 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0" returned: 0 in 0.355s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5312597-3c76-4062-ac87-4a5094a27493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88915) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc423455-f644-4ecb-be8a-9e25ff322b90]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:25 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:25 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 Jul 31 07:43:25 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:26 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493" returned: 0 in 0.377s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:26 devstack sudo[109635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 Jul 31 07:43:26 devstack sudo[109635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:26 devstack sudo[109635]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0" returned: 0 in 0.362s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:26 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0 Jul 31 07:43:26 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:26 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493.d3c53055-fcb0-4227-952b-fa14d277a8b0" returned: 0 in 0.252s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-d3c53055-fcb0-4227-952b-fa14d277a8b0" released by "_delete_snapshot" :: held 1.458s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-f5312597-3c76-4062-ac87-4a5094a27493" released by "delete_snapshot" :: held 1.480s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:26 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Created reservations ['c3d5dcef-2667-433f-a0a6-6132e083b4ba', 'c5d1dbde-c968-4f85-8ae4-97d4c29e5c93', 'e7a292e6-d8d8-49bf-8990-3afe298ca394', '799bbaaa-b6b3-4210-a19a-287c07f22596'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:27 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Delete snapshot completed successfully. Jul 31 07:43:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-cd211323-e404-4437-bdfa-0865556fddd9 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-d3c53055-fcb0-4227-952b-fa14d277a8b0-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-f5312597-3c76-4062-ac87-4a5094a27493-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-f5312597-3c76-4062-ac87-4a5094a27493-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-quobyte-f5312597-3c76-4062-ac87-4a5094a27493" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:27 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-f5312597-3c76-4062-ac87-4a5094a27493" acquired by "delete_volume" :: waited 0.014s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:27 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52def21-df60-43c9-8e11-f33e1dc86e79]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:27 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:27 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 Jul 31 07:43:27 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:28 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493" returned: 0 in 0.378s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:28 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493 Jul 31 07:43:28 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:28 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-f5312597-3c76-4062-ac87-4a5094a27493" returned: 0 in 0.256s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-f5312597-3c76-4062-ac87-4a5094a27493" released by "delete_volume" :: held 0.706s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Created reservations ['508b1dee-729b-44f9-ba2a-c84709792db3', '5d4126bb-fbdd-40b6-b8d8-f431518c0262', '1fba91e2-1f97-4312-a3f4-b0b7d9b056d7', '85d1ecff-6b88-4c4c-9a57-f812f5c2b3c5'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:28 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:28 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:28 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.257s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:28 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Deleted volume successfully. Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-879005e9-9870-445d-98a6-dcf930aeb746-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-ca3a2e9a-9f3b-498d-875c-602886df4587 tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-f5312597-3c76-4062-ac87-4a5094a27493-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-879005e9-9870-445d-98a6-dcf930aeb746-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "cinder-quobyte-879005e9-9870-445d-98a6-dcf930aeb746" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-879005e9-9870-445d-98a6-dcf930aeb746" acquired by "delete_volume" :: waited 0.017s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e1e4a9-bd9d-4d2c-9058-04d2ddb08536]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:28 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:28 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 Jul 31 07:43:28 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:29 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746" returned: 0 in 0.370s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:29 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746 Jul 31 07:43:29 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:29 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-879005e9-9870-445d-98a6-dcf930aeb746" returned: 0 in 0.249s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-quobyte-879005e9-9870-445d-98a6-dcf930aeb746" released by "delete_volume" :: held 0.670s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Created reservations ['0a21104f-55a4-4c4d-bce1-d985747c5ea4', '22b1659e-e938-4eb3-8a03-9b4a6afb0adf', 'd5783f3a-6a75-4dc6-9539-98b07c3f2c17', 'f48f2ee4-f048-4aa7-b4b0-cd741b312615'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:29 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:29 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:43:29 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (201abe0b-fb47-4837-a6b2-f154ed7d9dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe58914-89e1-4261-8df0-f479a9cc25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.325s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:29 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe58914-89e1-4261-8df0-f479a9cc25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145599474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a294d3-ed89-4c1c-b4f1-d078c63d10e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:30Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae2e88e-50b7-47f2-8a09-0c8e8a8c17ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae2e88e-50b7-47f2-8a09-0c8e8a8c17ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f89816-8f11-4313-a41d-b718ec91e28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f89816-8f11-4313-a41d-b718ec91e28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a294d3-ed89-4c1c-b4f1-d078c63d10e9', 'volume_name': 'volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b275d1-744a-458d-b98d-c34bcaa9ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b275d1-744a-458d-b98d-c34bcaa9ee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48af9b1f-1bea-4d64-9e9f-d08c6d0c8866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:30 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Volume 75a294d3-ed89-4c1c-b4f1-d078c63d10e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9', 'volume_size': 1} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145599474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a294d3-ed89-4c1c-b4f1-d078c63d10e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:30Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Creating volume 75a294d3-ed89-4c1c-b4f1-d078c63d10e9 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:43:30 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Deleted volume successfully. Jul 31 07:43:30 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 1073741824 Jul 31 07:43:30 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-51e4f701-c480-4f8e-83b7-abd14478edbd tempest-SnapshotDependencyTests-1950731997 None] Lock "cinder-879005e9-9870-445d-98a6-dcf930aeb746-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:30 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 1073741824" returned: 0 in 0.443s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:30 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 Jul 31 07:43:30 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:30 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9" returned: 0 in 0.287s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48af9b1f-1bea-4d64-9e9f-d08c6d0c8866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2b7765-318c-49fb-8eeb-5ede12545287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:30 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Volume volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 (75a294d3-ed89-4c1c-b4f1-d078c63d10e9): created successfully Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2b7765-318c-49fb-8eeb-5ede12545287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:30 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (201abe0b-fb47-4837-a6b2-f154ed7d9dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:30 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-fd213f2a-88cf-46e2-a06c-7a74e3073885 tempest-ProjectReaderTests-955374987 None] Created volume successfully. Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-75a294d3-ed89-4c1c-b4f1-d078c63d10e9-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Lock "cinder-75a294d3-ed89-4c1c-b4f1-d078c63d10e9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-quobyte-75a294d3-ed89-4c1c-b4f1-d078c63d10e9" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-75a294d3-ed89-4c1c-b4f1-d078c63d10e9" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da8cf3-32bc-4c60-b649-53d09b82350e]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:32 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 Jul 31 07:43:32 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:32 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9" returned: 0 in 0.448s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:32 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9 Jul 31 07:43:32 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:32 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-75a294d3-ed89-4c1c-b4f1-d078c63d10e9" returned: 0 in 0.265s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:32 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-75a294d3-ed89-4c1c-b4f1-d078c63d10e9" released by "delete_volume" :: held 0.757s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Created reservations ['04170b7c-1ac8-43bf-b81f-76aaae719a22', 'd13995c0-e24e-4ecc-ae81-fff0f5be2f2e', '40adfab3-d4f8-4a13-ae41-fd10de191d8e', '237aa46d-7452-45da-be0f-a75d72348850'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:33 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:33 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:33 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.275s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:33 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Deleted volume successfully. Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-a570fba3-4768-4f73-bdde-cdb24b804541 tempest-ProjectReaderTests-955374987 None] Lock "cinder-75a294d3-ed89-4c1c-b4f1-d078c63d10e9-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:33 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:33 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (35f38bfb-765e-4b5e-8d1a-6ad5d98e78c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f5810b-ab50-4dd9-a1bf-aee13b493af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f5810b-ab50-4dd9-a1bf-aee13b493af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449790587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d269273-a7e3-4d23-a216-12ec40eef84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:34Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0487280a-b01c-46f0-9f66-ffcf8c54ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0487280a-b01c-46f0-9f66-ffcf8c54ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8df179e-0308-41dd-8f5e-4acaab658ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8df179e-0308-41dd-8f5e-4acaab658ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d269273-a7e3-4d23-a216-12ec40eef84f', 'volume_name': 'volume-2d269273-a7e3-4d23-a216-12ec40eef84f', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec0288-a24a-496c-91a1-8fd44d4a1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec0288-a24a-496c-91a1-8fd44d4a1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f06ccb-0134-4ad1-bb16-fd053a565079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:33 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Volume 2d269273-a7e3-4d23-a216-12ec40eef84f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d269273-a7e3-4d23-a216-12ec40eef84f', 'volume_size': 1} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449790587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d269273-a7e3-4d23-a216-12ec40eef84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:34Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Creating volume 2d269273-a7e3-4d23-a216-12ec40eef84f {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:43:33 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:43:33 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:33 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f 1073741824 Jul 31 07:43:33 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:34 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.290s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG oslo_service.periodic_task [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] Running periodic task VolumeManager._thread_info {{(pid=88915) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread count: 28 {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-bc4f26b3-b2a4-4150-a850-270885288a35 None None] thread info: [<_MainThread(MainThread, started 134704360243328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88915) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 07:43:34 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f 1073741824" returned: 0 in 0.477s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:34 devstack sudo[109699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f Jul 31 07:43:34 devstack sudo[109699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:34 devstack sudo[109699]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f" returned: 0 in 0.245s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f06ccb-0134-4ad1-bb16-fd053a565079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d269273-a7e3-4d23-a216-12ec40eef84f', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea72b25-56bd-4078-b719-d9a05e2db589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:34 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Volume volume-2d269273-a7e3-4d23-a216-12ec40eef84f (2d269273-a7e3-4d23-a216-12ec40eef84f): created successfully Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea72b25-56bd-4078-b719-d9a05e2db589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:34 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (35f38bfb-765e-4b5e-8d1a-6ad5d98e78c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:34 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-5513db8b-1660-4d4f-8e40-909b355c99ed tempest-ProjectReaderTests-955374987 None] Created volume successfully. Jul 31 07:43:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-2d269273-a7e3-4d23-a216-12ec40eef84f-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:35 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Lock "cinder-2d269273-a7e3-4d23-a216-12ec40eef84f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-quobyte-2d269273-a7e3-4d23-a216-12ec40eef84f" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-2d269273-a7e3-4d23-a216-12ec40eef84f" acquired by "delete_volume" :: waited 0.020s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a07842c-83a5-479f-bab9-1764e78264f4]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:36 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f Jul 31 07:43:36 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:36 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f" returned: 0 in 0.423s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:36 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f Jul 31 07:43:36 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:36 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-2d269273-a7e3-4d23-a216-12ec40eef84f" returned: 0 in 0.355s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-2d269273-a7e3-4d23-a216-12ec40eef84f" released by "delete_volume" :: held 0.824s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:36 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Created reservations ['dc7393e3-8ca6-4d98-894c-bb8fcc4c5d80', '2b5c779b-373e-4bea-b8bf-a6430b125101', '3b01e665-6370-43ba-ba0b-bbe70fb2b650', '63beb26a-9d82-4e7f-a636-dfb385e60374'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:37 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:37 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:37 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.302s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:37 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Deleted volume successfully. Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-755e6818-ec89-475a-8032-29a47fc1525d tempest-ProjectReaderTests-955374987 None] Lock "cinder-2d269273-a7e3-4d23-a216-12ec40eef84f-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (3fb315e2-e97d-4301-b2fb-6c43ef3af33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a7f9af-a38c-46bb-ba69-63bbb1184aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a7f9af-a38c-46bb-ba69-63bbb1184aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480383520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8feac2f9-31ab-4c8b-839a-fc9a9c8895c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:38Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45d59e4-9767-4730-b1f5-4f039e3cfb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45d59e4-9767-4730-b1f5-4f039e3cfb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7740fdd-aa8c-4885-ace4-5017a7d6228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7740fdd-aa8c-4885-ace4-5017a7d6228a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8feac2f9-31ab-4c8b-839a-fc9a9c8895c7', 'volume_name': 'volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a70bc92-447f-4e80-ac1c-ff1f650e4995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a70bc92-447f-4e80-ac1c-ff1f650e4995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306432ad-76c1-4b79-b825-3d4f2c1a85bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:37 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Volume 8feac2f9-31ab-4c8b-839a-fc9a9c8895c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7', 'volume_size': 1} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480383520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8feac2f9-31ab-4c8b-839a-fc9a9c8895c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:38Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Creating volume 8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:43:37 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:43:37 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:37 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 1073741824 Jul 31 07:43:37 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:38 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 1073741824" returned: 0 in 0.529s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:38 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 Jul 31 07:43:38 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:38 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7" returned: 0 in 0.257s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306432ad-76c1-4b79-b825-3d4f2c1a85bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692ccd51-d918-4b7a-8685-c066d81708eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:38 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Volume volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 (8feac2f9-31ab-4c8b-839a-fc9a9c8895c7): created successfully Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692ccd51-d918-4b7a-8685-c066d81708eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:38 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (3fb315e2-e97d-4301-b2fb-6c43ef3af33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:38 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-9b98a089-ef86-4cac-9fb9-7272ecee4a00 tempest-ProjectReaderTests-955374987 None] Created volume successfully. Jul 31 07:43:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Lock "cinder-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-quobyte-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:39 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7" acquired by "delete_volume" :: waited 0.021s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:39 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0f4dcb-f33a-48b2-afc0-c90425bb722f]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:39 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:39 devstack sudo[109768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 Jul 31 07:43:39 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:40 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7" returned: 0 in 0.350s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:40 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7 Jul 31 07:43:40 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:40 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7" returned: 0 in 0.263s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7" released by "delete_volume" :: held 0.653s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Created reservations ['06f2b7ce-ecac-43c4-ac3e-9729971fa3a6', 'cc40b20c-582d-4ff6-81db-301ae6034165', 'a9bcb43d-1dc4-4d0f-9a22-30de31ac99a3', 'd0ff38b3-b780-4ac4-83a7-62153d7d851a'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:40 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:40 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:40 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.246s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:40 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Deleted volume successfully. Jul 31 07:43:40 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-af73b98f-514c-48b0-8f3c-e15c42fd11e4 tempest-ProjectReaderTests-955374987 None] Lock "cinder-8feac2f9-31ab-4c8b-839a-fc9a9c8895c7-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.flows.manager.create_volume [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88915) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (10be3160-86d8-4658-aa4a-4dfd3da5de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d600bcf0-0f33-41c3-a125-0548e9da0d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d600bcf0-0f33-41c3-a125-0548e9da0d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186607484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d3eed7-dd3a-4225-9b85-9b0b412990e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:41Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c91a5c-48b7-4309-8ab2-6125f8b3e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c91a5c-48b7-4309-8ab2-6125f8b3e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10253167-ba1b-46c0-8fad-e1e2762f8d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10253167-ba1b-46c0-8fad-e1e2762f8d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d3eed7-dd3a-4225-9b85-9b0b412990e6', 'volume_name': 'volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b9b120-4565-47a6-9df5-e510baa215c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b9b120-4565-47a6-9df5-e510baa215c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34004b68-5a3d-445e-b903-6d5923c98361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:41 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Volume a6d3eed7-dd3a-4225-9b85-9b0b412990e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6', 'volume_size': 1} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T05:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186607484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d3eed7-dd3a-4225-9b85-9b0b412990e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43fd12e244f460f87a96a57b246a6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T05:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T05:43:41Z,use_quota=True,user_id='9cfb11eee373416dbba19a3d0b432611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4),volume_type_id=164713cc-83bb-4a3b-a4e2-9d1c92b7d0a4)}" {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.remotefs [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Creating volume a6d3eed7-dd3a-4225-9b85-9b0b412990e6 {{(pid=88915) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Selected osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 as target Quobyte volume. {{(pid=88915) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 31 07:43:41 devstack cinder-volume[88915]: INFO cinder.volume.drivers.remotefs [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] casted to osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80 Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 1073741824 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:41 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 1073741824 Jul 31 07:43:41 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:41 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 1073741824" returned: 0 in 0.404s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:41 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:41 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 Jul 31 07:43:41 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:42 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6" returned: 0 in 0.256s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'} {{(pid=88915) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34004b68-5a3d-445e-b903-6d5923c98361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6', 'volume_size': 1}' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b6d7cc-9e09-407e-8cd7-d7680e96a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 07:43:42 devstack cinder-volume[88915]: INFO cinder.volume.flows.manager.create_volume [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Volume volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 (a6d3eed7-dd3a-4225-9b85-9b0b412990e6): created successfully Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b6d7cc-9e09-407e-8cd7-d7680e96a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88915) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Flow 'volume_create_manager' (10be3160-86d8-4658-aa4a-4dfd3da5de1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88915) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 07:43:42 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-e877d48e-be81-4d9d-bc67-58e403d847ca tempest-ProjectReaderTests-955374987 None] Created volume successfully. Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-a6d3eed7-dd3a-4225-9b85-9b0b412990e6-delete_volume" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Lock "cinder-a6d3eed7-dd3a-4225-9b85-9b0b412990e6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Acquiring lock "cinder-quobyte-a6d3eed7-dd3a-4225-9b85-9b0b412990e6" by "delete_volume" {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-a6d3eed7-dd3a-4225-9b85-9b0b412990e6" acquired by "delete_volume" :: waited 0.015s {{(pid=88915) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3807f41-6fe3-432b-b09c-5c06b1907637]: (4, 'qcow2') {{(pid=91866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:42 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 Jul 31 07:43:42 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:42 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6" returned: 0 in 0.354s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:42 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:42 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6 Jul 31 07:43:42 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:43 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937/volume-a6d3eed7-dd3a-4225-9b85-9b0b412990e6" returned: 0 in 0.242s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Lock "cinder-quobyte-a6d3eed7-dd3a-4225-9b85-9b0b412990e6" released by "delete_volume" :: held 0.634s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG cinder.quota [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Created reservations ['3be081c2-dc3f-4295-b910-bf8f0f6780fe', 'c2f2f1d7-a59e-465e-ae43-194b4f163f78', 'd4e471ea-6167-4458-82e4-d2b546f1c3a8', '8ec42613-8330-4fda-b70f-4902cdce299d'] {{(pid=88915) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80': None} {{(pid=88915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG cinder.volume.drivers.quobyte [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98fc9183-3200-4563-9741-cabc5c488e80'] {{(pid=88915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.lockutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 07:43:43 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937 Jul 31 07:43:43 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 07:43:43 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG oslo_concurrency.processutils [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe092cdc699f30644688cd5afcd9937" returned: 0 in 0.240s {{(pid=88915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG cinder.manager [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Notifying Schedulers of capabilities ... {{(pid=88915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 07:43:43 devstack cinder-volume[88915]: INFO cinder.volume.manager [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Deleted volume successfully. Jul 31 07:43:43 devstack cinder-volume[88915]: DEBUG cinder.coordination [None req-97bef850-ab31-471d-865d-f0d34170cba6 tempest-ProjectReaderTests-955374987 None] Lock "cinder-a6d3eed7-dd3a-4225-9b85-9b0b412990e6-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=88915) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 07:43:53 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=62,cinder:DELETE=7,cinder:INSERT=21,cinder:UPDATE=89 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 07:43:53 devstack cinder-volume[88915]: DEBUG dbcounter [-] [88915] Writing DB stats cinder:SELECT=63,cinder:INSERT=22,cinder:UPDATE=84,cinder:DELETE=8 {{(pid=88915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}